Clera

Senior Data Engineer

remote. Posted 9 days ago

The role

You will own a data platform end to end from architecture and ingestion to production operations. You will design and build a multi-source data platform for ingestion, processing, and orchestrated workflows.

What you will do

  • Design and build a multi-source data platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows
  • Ingest data from provider APIs, webhooks, files, and web scraping
  • Orchestrate scheduled workflows and historical backfills using tools such as Airflow, Dagster, or Prefect
  • Build event-driven systems with messaging or task queues
  • Preserve original payloads in Google Cloud Storage and transform data with dbt
  • Implement idempotent upserts, data contracts, validation, pipeline tests, and monitoring
  • Design and optimize PostgreSQL schemas and loading patterns
  • Integrate enrichment and LLM-based structured extraction

Required qualifications

  • At least 5 years building and operating production data platforms
  • Production experience with workflow orchestration, including dependencies, retries, and failure recovery
  • Hands-on production experience with dbt and Google Cloud Platform
  • Strong Python skills, including asynchronous HTTP and concurrent processing with asyncio, aiohttp, or HTTPX
  • Strong SQL and PostgreSQL skills, including data modeling, query optimization, and incremental loading
  • Experience with event-driven systems, messaging or task queues, and asynchronous failure recovery
  • Experience with data contracts, raw and curated storage, retention policies, automated validation, pipeline testing, and monitoring

Nice to have

  • Airflow experience
  • Experience building platforms or substantial pipelines from scratch
  • Web scraping
  • Entity resolution
  • LLM-based extraction
  • BigQuery
  • Dataform experience

Before you apply

  • Visa sponsorship is not available

About the company

clera has a data infrastructure and analytics team building a platform that turns information from multiple sources into reliable, up-to-date company intelligence.