Sarvam

Senior Software Engineer - Data Infrastructure

Bengaluru. Posted 2 days ago

The role

You will own Sarvam's central data platform: the ingestion path, the ClickHouse warehouse, and the pipelines that other teams depend on. You will design, build and run these systems in production and handle their incidents.

What you will do

  • Build and run the ingestion path: the service products send events to, Kafka behind it, and pipes that land data in ClickHouse within seconds.
  • Own schema validation, rate limits, dead-letter handling and the client SDKs.
  • Own the ClickHouse Cloud warehouse: table design, separate compute per workload, per-user limits, per-tenant isolation, and cost attribution.
  • Build dbt models and Airflow DAGs, CDC from product databases, and sync and backfill jobs that are safe to re-run.
  • Solve data problems product teams raise, such as late sources, mismatched numbers and slow queries.
  • Build a self-serve registry of datasets with owner, schema, freshness and access, and manage provisioning and permissions as code.
  • Run the platform with Terraform and Helm, metrics, traces and alerts; be on call and handle incidents end to end, including RCAs and root-cause fixes.
  • Help decide what the platform does next and build new sources, sinks and ways for teams to use the data.

Required qualifications

  • 2 to 5 years of experience building, shipping and running large-scale, data-intensive systems in production.
  • Deep expertise in at least one of: an OLAP database (ClickHouse preferred; Druid, BigQuery or Redshift also fine) or Kafka / event streaming.
  • Experience with large-scale messaging systems like Kafka or RabbitMQ: partitions, consumer groups, delivery guarantees, backpressure.
  • Good at Go, or good at Python.
  • Knowledge of schema evolution, idempotency, backpressure, partitioning, retention and TTL, and CDC.
  • Built or run at least one of: an event pipeline, a transformation layer, a provisioning or control-plane service, or a multi-tenant data service with access control.
  • Comfortable with AWS, Kubernetes and Terraform in production.
  • Test before shipping, debug with metrics and traces, write RCAs, and document what you build.
  • Passion for data infrastructure and for enabling others by making their data easier to access.

Nice to have

  • ClickHouse in production: MergeTree, materialized views, projections, quotas, settings profiles, row policies, ClickHouse Cloud.
  • Kafka in depth: MSK, Kafka Connect, schema registry (Glue or Confluent), Avro.
  • dbt and Airflow at scale.
  • Audit or security data systems: append-only logs, integrity checks, tenant isolation.
  • OpenTelemetry, LLM observability (Langfuse or similar), eval pipelines.
  • Built an internal platform that other teams adopted.

Before you apply

  • The posting describes a Software Engineer / Senior Software Engineer role for 2 to 5 years of experience.

About the company

Sarvam builds products that produce events, model traces, evals and billing data. Its Data Platform team runs the central data infrastructure that every product uses.

Senior Software Engineer - Data Infrastructure at Sarvam | JobZoey