Senior Data Infra Engineer

The role

This person will build and scale batch and streaming pipelines at the core of the platform. They will own the streaming data backbone, maintain batch pipelines, and drive pipeline observability.

What you will do

• Own the streaming data backbone by designing and operating high-throughput Kafka pipelines.
• Build and maintain batch pipelines at scale using Spark jobs.
• Drive pipeline observability through data quality checks, freshness monitors, and anomaly alerts.
• Model structured and unstructured data to serve analytics and product use cases.
• Partner with data scientists and platform engineers to drive data infrastructure decisions.
• Improve efficiency by reducing compute costs and job latency.
• Contribute to shared infrastructure including pipeline framework standards and orchestration patterns.
• Mentor junior engineers on the team.

Required qualifications

• 5+ years of data engineering experience
• At least 3 years owning production pipelines in a distributed data environment
• Strong hands-on experience with Spark and Kafka at scale
• Experience with big-data technologies including Hadoop, Presto/Trino, and Flink
• Proficiency in Python and SQL
• Experience working in a cloud environment, preferably AWS (S3, EMR, Glue, Redshift)
• Track record of improving efficiency, scalability, and stability of data systems
• BS or MS in Computer Science or equivalent
• Strong communication skills

Nice to have

• Scala

Benefits

• Health, dental, and vision care for you and your family (100% coverage for employee)
• Top-tier 401(K) plan with company matching
• Paid time off and paid holidays
• FSA, HSA and commuter benefits programs
• Team activity budget

About the company

NewsBreak is a local life and news platform with more than 40 million monthly users. It includes platforms like NewsBreak, Nearby AI, and NDot AI.