Technical Project Manager

The role

You will lead large-scale multilingual data collection, human-in-the-loop workflows, and Large Language Model evaluation initiatives. You will work with AI specialists, engineering teams, and data operations teams to translate technical requirements into data workflows and delivery plans.

What you will do

• Manage Applied AI data collection and evaluation projects from scoping through delivery.
• Translate technical AI requirements into data specifications and evaluation plans.
• Manage timelines, throughput velocity, dependencies, and technical blockers.
• Coordinate data collection and annotation for SFT, RLHF, and model evaluation.
• Partner with engineering teams to define and validate data workflows and integrations.
• Operationalize hybrid evaluation methodologies and LLM-as-a-judge frameworks.
• Coordinate requirements for data formats, schemas, and annotation tools.
• Use SQL and business intelligence tools to analyze throughput, quality, and unit economics.
• Define and monitor quality standards like inter-annotator agreement and dataset completeness.
• Communicate project status, technical risks, and unit economics to stakeholders.

Required qualifications

• 3–5+ years of technical project management experience in AI/ML, data platforms, or technical data operations.
• Strong understanding of LLM training and evaluation concepts, including SFT, RLHF, human evaluation, automated evaluations, LLM-as-a-judge, and red teaming.
• Proficiency in SQL for analyzing delivery velocity, data quality metrics, and cost structures.
• Working knowledge of data pipelines, structured data formats, APIs, and validation processes.
• Experience partnering with engineers to manage technical requirements, dependencies, and issue resolution.
• Proven ability to track and optimize project unit economics and delivery velocity.
• Strong communication skills for translating technical requirements for multilingual audiences and global contributor networks.
• Experience managing complex workflows using Agile, Scrum, or Kanban.

Nice to have

• Experience using Python or scripting tools for data analysis, workflow automation, or evaluation scripting.
• Experience managing high-skill Subject Matter Experts (SMEs) or specialized contributor networks across technical domains.
• Experience with annotation platforms, automated evaluation tools, business intelligence tools, and Jira.
• Experience delivering complex multilingual or multimodal data projects.
• Background in computer science, data science, engineering, or equivalent practical experience.
• Fluency in an additional language.

About the company

LILT is a machine learning company founded in 2015 that uses AI, machine translation, and human-in-the-loop expertise to translate content. The company is building a category-defining company in the global translation market.