Engineering Manager, Big Data, Job Understanding

The role

You will lead a team of 5 senior engineers who build job ingestion pipelines and data stores. You will drive a rebuild of the job ingestion pipeline and improve data quality and fraud detection.

What you will do

• Lead, mentor, and unblock a senior team of 5 engineers responsible for core job ingestion pipelines and data stores.
• Drive the rebuild of the job ingestion pipeline and refine how job data is exposed to consuming engineering teams.
• Prioritize initiatives that improve input data quality and handle low-structure, user-generated content.
• Own and lead improvements to fraud detection and blocking mechanisms.
• Partner with Engineering stakeholders, Data Scientists, and a Product Manager to balance requests and roadmap priorities.
• Scale data pipelines for performance and maintainability, and act on learnings about jobs in real time.

Required qualifications

• 5+ years of professional software development experience.
• 2+ years of experience as a software engineering leader.
• Deep experience with modern big data frameworks (e.g. Spark, Hadoop, Hive).
• Streaming technologies (Kafka, Flink, Beam).
• Strong CS fundamentals (data structures, algorithms) and coding skills.
• Experience with containerization technologies like Docker and Kubernetes.
• Experience working on a B2C or B2B product.
• Engineers who talk with Product Managers about problems and turn them into engineering solutions.
• Experience dealing with messy or unreliable data (third-party data sets, data integrations, migrations).

Nice to have

• Cloud platforms (GCP, AWS, Azure).
• Modern data storage solutions (Delta Lake, HBase, Hudi).
• Scala.

Benefits

• Competitive compensation.
• Exceptional benefits package.
• Flexible vacation and paid time off.
• Employer-matched 401(k) plan.
• Full range of medical, financial, and other benefits.

Before you apply

• Must be a US-based position for the posted US salary range; most US-based positions can also be performed remotely.

About the company

ZipRecruiter is a leading online employment marketplace that uses AI-driven smart matching to connect job seekers and businesses. Its mission is to actively connect people to their next great opportunity.