Quality Control Lead

The role

The Quality Control Lead will own the final checkpoint between raw data and delivered product. You will audit outputs for correctness, automate QC workflows, and report on quality metrics to leadership.

What you will do

• Own the last quality checkpoint before datasets are delivered or published.
• Audit outputs including code, technical, and reasoning data for correctness, clarity, structure, and adherence to spec.
• Work with infrastructure engineers to continuously automate and improve QC workflows.
• Partner with data delivery teams to identify systemic quality issues.
• Feed corrections back into contributor training to prevent recurrence.
• Own quality metrics and KPIs.
• Report on error rates, root causes, and improvement trends to company leadership.
• Contribute to company-wide initiatives across building, analysis, coordination, and execution.

Required qualifications

• 3+ years of experience in a technical role (software engineering, data science, ML engineering, or similar) with hands-on proficiency in at least one modern programming language
• Proven ability to review, debug, and evaluate both code and technical data and knowledge work data for correctness, structure, and quality
• Demonstrated rigor in reviewing others' work
• Experience building or leading a quality assurance/quality control function, ideally for a technical or data-centric product
• Extremely high attention to detail and comfort making judgment calls on ambiguous or contested technical content
• Strong leadership and communication skills
• High agency and strong work ethic
• Comfort operating with minimal direction in ambiguous, fast-moving environments
• Genuine passion for AI and an entrepreneurial inclination
• Demonstrated competitive success

Nice to have

• Experience in AI training data, RLHF, or data-annotation quality assurance
• Background reviewing datasets across multiple domains (code, reasoning, knowledge work)
• Experience designing rubrics, grading criteria, or automated quality-check tooling/scripts
• Familiarity with Claude Code or similar AI-assisted workflow tools
• Computer science degree or equivalent hands-on engineering background

Benefits

• Medical, Vision, Dental
• 401(k) with Employer Match
• Daily UberEats Stipend
• Monthly Wellness Stipend

About the company

AfterQuery is an applied research lab curating data solutions for foundation model development. They serve frontier AI labs to deliver data to power models.