Senior Quality Manager, Applied AI

The role

The Senior Quality Manager, Applied AI will ensure Applied AI deliverables meet quality thresholds and manage technical quality infrastructure. They will own operational quality at scale and handle customer quality remediation through quantitative analysis.

What you will do

• Ensure workflows are built for quality with measured rater agreement and reproducible rubric scores.
• Own technical tooling and quality infrastructure to make quality metrics available without manual compilation.
• Own operational quality at scale to meet quality targets within agreed cost and throughput.
• Execute delivery sign-off with documented go/no-go decisions before shipping.
• Own customer quality remediation by closing disputes with quantitative analysis.

Required qualifications

• B.S./M.S. in a quantitative field (CS, Statistics, Data Science, Engineering, Linguistics, HCI) or equivalent practical experience.
• 6+ years building or operating quality programs for ML/LLM systems.
• Ability to design and run end-to-end quality frameworks across multiple concurrent programs.
• Strong grasp of reliability and agreement methods, power/sample-size intuition, error analysis, and reporting.
• Experience with calibration, adjudication, targeted retraining, drift monitoring, and integrity/fraud detection.
• Hands-on with labeling/eval tooling and designing deterministic validations.
• Comfort partnering with engineering/research to implement quality instrumentation.
• Strong understanding of dataset/version management, traceability, privacy/compliance constraints, and audit-ready documentation.
• Excellent written and verbal communication.
• Ability to translate ambiguous research goals into measurable quality targets and negotiate tradeoffs.

Nice to have

• Fluency in multiple human languages.
• Proficiency in a programming language and experience working with modern AI frameworks.

Before you apply

• Authorization to work in the U.S. is a precondition of employment.

About the company

LILT is a machine learning company founded in 2015 that uses AI, machine translation, and human-in-the-loop expertise to translate content. The company aims to make the world's information accessible to everyone regardless of language.