Zetaglobal
Senior Software Engineer, Data Platform
San Francisco, CA. Posted a month ago
The role
You will build and operate the data infrastructure behind Zeta's products, analytics, machine learning and AI systems. The role is a broad platform role covering Lakehouse architecture, distributed compute, data quality, governance, security and platform operations.
What you will do
- Build and operate Lakehouse, Spark, and distributed data-processing systems.
- Improve the performance, reliability, cost, and operational visibility of platform workloads.
- Develop capabilities for data quality, governance, lineage, metadata, discoverability, security, and access control.
- Build the data context required for trusted reporting, ML models, and AI agents.
- Evaluate compute and query engines for read-heavy workloads, assessing cost, performance, reliability, and operational fit.
- Assess real-time OLAP technologies and identify appropriate production use cases.
- Improve deployment, observability, incident response, developer tooling, and platform operations.
- Partner with data scientists and data engineers to improve their experience using the platform.
- Contribute fixes and improvements to relevant open-source projects, including Spark, Iceberg, and Airflow.
- Mentor engineers through code reviews, pairing, design discussions, and knowledge-sharing sessions.
Required qualifications
- 7+ years of software engineering experience.
- Strong experience in Python, Scala, Java, or another JVM language.
- Experience with Spark or another distributed data-processing framework.
- Experience building or operating production data platforms, backend systems, or distributed systems.
- Familiarity with at least 1 of these areas: Lakehouse architecture, Apache Iceberg, data quality, governance, lineage, metadata, query engines, or real-time OLAP.
- Working knowledge of AWS services such as EC2, S3, Athena, and IAM.
- Experience improving production reliability through monitoring, alerting, deployment automation, and incident response.
- Strong analytical, communication, and collaboration skills.
Nice to have
- Experience with Kubernetes, Terraform, Airflow, Trino, ClickHouse, Starrocks, or Pinot.
Benefits
- Unlimited PTO
- Excellent medical, dental, and vision coverage
- Employee Equity and Stock Purchase Plan
- Employee Discounts
- Virtual Wellness Classes
- Pet Insurance
About the company
Zeta Global is an AI-Powered Marketing Cloud that helps marketers acquire, grow and retain customers using AI and consumer signals. It was founded in 2007 and is headquartered in New York City with offices around the world.