Engineering Manager, Big Data, Job Understanding

The role

You will lead a team of 5 senior engineers who build and run core job ingestion pipelines and data stores. You will drive the rebuild of the job ingestion pipeline and improve job data quality and fraud detection.

What you will do

• Lead, mentor, and unblock a senior team of 5 engineers responsible for core job ingestion pipelines and data stores
• Drive the rebuild of the job ingestion pipeline and refine how job data is exposed to consuming engineering teams
• Prioritize initiatives that improve input data quality and handle low-structure, user-generated content
• Own and lead improvements to fraud detection and blocking mechanisms
• Partner with Engineering stakeholders, Data Scientists, and a Product Manager to balance requests and roadmap priorities
• Scale data pipelines for performance and maintainability so job data can be acted on in real time

Required qualifications

• 5+ years of professional software development experience
• 2+ years of experience as a software engineering leader
• Deep experience with modern big data frameworks (e.g. Spark, Hadoop, Hive)
• Streaming technologies (Kafka, Flink, Beam)
• Strong CS fundamentals (data structures, algorithms) and coding skills
• Experience with containerization technologies like Docker and Kubernetes
• Experience working on a B2C or B2B product
• Works with Product Managers to turn problems into engineering solutions and is curious and deeply understands the product
• Experience dealing with messy or unreliable data (third-party data sets, data integrations, migrations)

Nice to have

• Cloud platforms (GCP, AWS, Azure)
• Modern data storage solutions (Delta Lake, HBase, Hudi)
• Scala

Benefits

• Competitive compensation
• Exceptional benefits package
• Flexible vacation and paid time off
• Employer-matched 401(k) plan
• Medical, financial, and other benefits

Before you apply

• Equal opportunity employer; employment decisions are made without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetic

About the company

ZipRecruiter is a leading online employment marketplace that uses AI-driven smart matching to connect job seekers and businesses. It operates through mobile, web, and email services and partnerships with job boards.