Clera
Senior Data Engineer, LATAM
remote. Posted 8 days ago
The role
You will own a data platform end-to-end from architecture and ingestion through production operations. You will design a multi-source data platform for ingestion, processing, and orchestrated workflows.
What you will do
- Design a multi-source data platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows.
- Build intake pipelines for APIs, webhooks, files, and web scraping.
- Orchestrate scheduled workflows and historical backfills using Airflow, Dagster, or Prefect.
- Develop messaging and task queue systems with retries, dead-letter queues, and controlled replay.
- Preserve source payloads in Google Cloud Storage and transform data with dbt.
- Implement idempotent upserts, data contracts, automated validation, pipeline tests, and monitoring.
- Design and optimize PostgreSQL schemas and loading patterns.
- Integrate enrichment and LLM-based structured extraction.
Required qualifications
- At least 5 years building and operating production data platforms across multiple sources.
- Hands-on production experience with dbt and Google Cloud Platform.
- Workflow orchestration using Airflow, Dagster, Prefect, Temporal, or a comparable tool.
- Strong Python skills, including asynchronous HTTP and concurrent processing with asyncio, aiohttp, or HTTPX.
- Strong SQL and PostgreSQL skills, including data modeling, query optimization, and reliable incremental loading.
- Experience building event-driven systems with messaging or task queues, asynchronous processing, and failure recovery.
- Experience with data contracts, raw and curated storage, retention policies, automated testing, and production monitoring.
Nice to have
- Airflow is preferred.
- Web scraping
- Entity resolution
- Company and people data enrichment
- LLM-based extraction
- Building platforms from scratch in small teams
Before you apply
- Visa sponsorship is not available.
About the company
clera has a data infrastructure and analytics team building a platform that turns information from multiple sources into reliable, current company intelligence.