Lilt Corporate
Manager, Production - Applied AI
Boston, MA, Remote. Posted 2 months ago
The role
The Manager, Production - Applied AI will manage PM performance, hiring, and development. They will oversee quality interventions, process standardization, and cross-functional escalations for AI data operations.
What you will do
- Manage PM performance against throughput, quality, and cost-per-task targets
- Handle PM hiring, onboarding, and development to maintain pool capacity
- Perform quality interventions through QA loops and retraining
- Standardize processes and improve software via shared playbooks and dashboard standards
- Manage escalations between the PM pool, Quality, Talent, and Delivery
Required qualifications
- 5+ years in AI/ML data operations or production
- 2+ years directly managing project managers or team leads in a distributed, multi-time-zone contractor environment
- Strong understanding of LLM training processes (pre-training, SFT, RLHF) and evaluation methodologies
- Knowledge of what drives quality and throughput in annotation workflows
- Experience running teams against throughput, quality, and cost-per-task targets
- Advanced proficiency with spreadsheets and dashboards
- Ability to use SQL to extract and analyze performance data
- Sustained on-time delivery and acceptance targets across multiple concurrent programs
- Experience hiring, ramping, performance-managing, and offboarding hourly and freelance staff
- Proven track record using Agile, Scrum, or Kanban to manage complex workflows
- Ability to write clear, unambiguous guidelines and feedback for multilingual audiences
- Ability to communicate status, risk, and tradeoffs to leadership
Nice to have
- Fluency in multiple human languages
- Experience with multilingual data deliveries (pre-training, SFT, RLHF, machine translation, multimodal, etc.)
- Experience with data annotation platforms (e.g., Label Studio, SuperAnnotate)
- Experience with project management tooling (e.g., Jira)
- Background in ML engineering, computer science, or data science
Before you apply
- Authorization to work in the U.S. is a precondition of employment
About the company
LILT is a machine learning company founded in 2015 that uses AI, machine translation, and human-in-the-loop expertise to translate content. The company aims to make the world's information accessible to everyone regardless of language.