Gen Digital

Lead Data Platform Engineer

IND - Pune. Posted 5 months ago

The role

You will co-own the data platform architecture and set technical standards for the Data Engineering organization. You will lead the modernization of legacy infrastructure into a cloud-first platform and design scalable architectures for multi-TB daily workloads.

What you will do

  • Co-own and evolve the overall data platform architecture
  • Guide the technical vision for the Data Engineering organization
  • Lead the modernization of legacy systems
  • Design highly scalable platform architectures for multi-TB+ daily workloads
  • Author and sign off on RFCs and technical specifications
  • Build self-service infrastructure for data consumers
  • Design event-driven, real-time data architectures using Kafka
  • Architect Infrastructure as Code strategies and GitOps frameworks
  • Design enterprise-grade security frameworks
  • Mentor IC9 and IC10 engineers

Required qualifications

  • Expert-level proficiency in SQL, Python, and at least one additional programming language
  • Demonstrated mastery of object-oriented design and software engineering principles
  • Deep expertise with databases including PostgreSQL, MySQL, Snowflake, Oracle, DynamoDB, MongoDB
  • Extensive Kafka ecosystem expertise
  • Advanced container orchestration with Kubernetes and Docker at scale
  • Expert knowledge of Infrastructure as Code, GitOps, and cloud-native architectures
  • Proven track record architecting platforms processing multi-TB daily workloads
  • Experience designing and operating systems supporting hundreds of concurrent users
  • Deep understanding of distributed systems, cloud architectures, and scalability patterns
  • Expert-level experience with observability stacks (Prometheus, Grafana, ELK, Jaeger)
  • Mastery of data orchestration platforms like Airflow, Prefect, or Dagster
  • 10-15+ years of professional experience in data platform engineering or related field

Nice to have

  • Deep experience with modern data stack tools (dbt, Looker, etc.)
  • Machine learning infrastructure and MLOps architecture expertise
  • Contributions to open-source data infrastructure projects
  • Published technical articles, conference talks, or thought leadership in data platforms
  • Expert knowledge of data privacy frameworks (GDPR, CCPA) and implementation at scale

About the company

gen-digital is transforming legacy infrastructure into a modern cloud-first platform.