Lilt Corporate

Manager, Production - Applied AI

Boston, MA, Remote. Posted 2 months ago

The role

The Manager, Production - Applied AI will manage PM performance, hiring, and development. They will oversee quality interventions, process standardization, and cross-functional escalations for AI data operations.

What you will do

  • Manage PM performance against throughput, quality, and cost-per-task targets
  • Handle PM hiring, onboarding, and development to maintain pool capacity
  • Perform quality interventions through QA loops and retraining
  • Standardize processes and improve software via shared playbooks and dashboard standards
  • Manage escalations between the PM pool, Quality, Talent, and Delivery

Required qualifications

  • 5+ years in AI/ML data operations or production
  • 2+ years directly managing project managers or team leads in a distributed, multi-time-zone contractor environment
  • Strong understanding of LLM training processes (pre-training, SFT, RLHF) and evaluation methodologies
  • Knowledge of what drives quality and throughput in annotation workflows
  • Experience running teams against throughput, quality, and cost-per-task targets
  • Advanced proficiency with spreadsheets and dashboards
  • Ability to use SQL to extract and analyze performance data
  • Sustained on-time delivery and acceptance targets across multiple concurrent programs
  • Experience hiring, ramping, performance-managing, and offboarding hourly and freelance staff
  • Proven track record using Agile, Scrum, or Kanban to manage complex workflows
  • Ability to write clear, unambiguous guidelines and feedback for multilingual audiences
  • Ability to communicate status, risk, and tradeoffs to leadership

Nice to have

  • Fluency in multiple human languages
  • Experience with multilingual data deliveries (pre-training, SFT, RLHF, machine translation, multimodal, etc.)
  • Experience with data annotation platforms (e.g., Label Studio, SuperAnnotate)
  • Experience with project management tooling (e.g., Jira)
  • Background in ML engineering, computer science, or data science

Before you apply

  • Authorization to work in the U.S. is a precondition of employment

About the company

LILT is a machine learning company founded in 2015 that uses AI, machine translation, and human-in-the-loop expertise to translate content. The company aims to make the world's information accessible to everyone regardless of language.

Manager, Production - Applied AI at Lilt Corporate | JobZoey