Data Engineer

The role

You will build, deploy, and operate production Spark data pipelines on Databricks. You will work with product teams to turn analytics-product needs into pipeline requirements.

What you will do

• Build, deploy, and operate production Spark data pipelines on Databricks
• Partner with product teams to turn analytics-product needs into pipeline requirements
• Set up monitoring and observability
• Diagnose performance and cost problems and fix their root causes
• Recommend pragmatic standards for running pipelines

Required qualifications

• Hands-on experience building, deploying, and maintaining production Spark pipelines
• Deep understanding of clustering, shuffles, different join strategies, and batch versus stream processing tradeoffs
• Experience with reliability, monitoring, and observability
• Strong SQL
• Basic programming skills in any language
• Comfort working as an individual contributor, directly with product teams, and through ambiguity

Nice to have

• Python is a plus
• Familiarity with the Databricks ecosystem
• Experience with streaming pipelines and logical replication, such as replicating Postgres into Databricks
• Experience building RAG pipelines
• AWS infrastructure experience
• Platform administration experience: roles, permissions, access controls, and visibility management

About the company

Monaco is building an AI-native revenue platform that replaces the fragmented GTM stack. The company has raised $85M in its Series B from Founders Fund, Benchmark, and Human Capital.