Project Manager, Applied AI

The role

You will lead large-scale multilingual data collection and Large Language Model evaluation initiatives. You will orchestrate global teams of annotators and data specialists to optimize workflows for productivity, quality, and throughput.

What you will do

• Manage the full lifecycle of AI data projects from scoping to post-mortem analysis.
• Oversee large-scale data pipelines for multilingual data collection and LLM evaluation.
• Monitor and report on KPIs including throughput, quality, and productivity.
• Run QA loops, root-cause analysis, and corrective training for annotator pools.
• Maintain dashboards to visualize project health and flag bottlenecks.
• Manage relationships with data experts and crowd pools.
• Liaise with Applied AI Technical Ops teams.
• Translate technical requirements into actionable guidelines for non-technical annotators.
• Facilitate feedback loops to update annotation guidelines and model fine-tuning strategies.

Required qualifications

• 3-5+ years of project management experience within AI/ML data operations.
• Strong understanding of LLM training processes (Pre-training, SFT, RLHF) and evaluation methodologies (Human-in-the-loop, red teaming).
• Advanced proficiency in Excel/Google Sheets.
• Ability to write SQL queries to extract and analyze performance data.
• Proven track record using Agile, Scrum, or Kanban methodologies.

Nice to have

• Fluency in a second language is highly desirable.
• Experience with data annotation platforms (e.g. Scale AI, Super Annotate).
• Experience with project management tools (e.g. Jira).
• Background in ML Engineering, Computer Science, Data Science and Project Management training.

About the company

LILT is a machine learning company that uses AI, machine translation, and human-in-the-loop expertise to translate content. The company aims to make the world's information accessible to everyone regardless of language.