Lilasciences

Senior / Staff Machine Learning Engineer, Applied AI

Cambridge, MA USA; San Francisco, CA USA. Posted 4 months ago

The role

You will improve Lila's AI models for customer-specific scientific needs. This involves training or adapting models, building evaluation loops, and integrating model behavior into product workflows.

What you will do

  • Close the last-mile gap between Lila AI model capabilities and customer-specific scientific workflows.
  • Build evaluation loops that measure model quality, reliability, and customer fit.
  • Design experiments to improve model performance across applied customer use cases.
  • Feed customer learnings, data signals, and evaluation results back into the Lila AI model improvement cycles.
  • Partner with AI researchers to translate model improvements into usable capabilities.
  • Work with Software to integrate model behavior into end-to-end product workflows.
  • Debug model failures using traces, evaluations, customer context, and scientific feedback.
  • Build reusable tooling for model adaptation, evaluation, and deployment workflows.

Required qualifications

  • Strong experience building, training, adapting, or evaluating machine learning models.
  • Strong software engineering skills in Python and modern ML frameworks such as PyTorch, JAX, or TensorFlow.
  • Experience with distributed ML training frameworks (Megatron-LM, TorchTitan, DeepSpeed, Ray)
  • Experience designing experiments, evaluation metrics, or test sets for model performance.
  • Ability to debug model behavior using data, traces, logs, and qualitative feedback.
  • Experience working across research and engineering teams to move ML capabilities into usable systems.
  • Familiarity with large language models, multi-modal models, or agentic AI systems.
  • Clear communication skills for translating customer needs into technical model improvements.

Nice to have

  • Experience adapting models for customer-facing or production workflows.
  • Experience with scientific, technical, or data-intensive customer use cases.
  • Experience building evaluation harnesses, model monitoring, or quality dashboards.
  • Familiarity with retrieval-augmented generation, tool use, or agentic workflows.
  • Experience with RL post-training, such as RLHF, GRPO, or tool-augmented RL.
  • Experience training MoE architectures.
  • Experience working with product or customer-facing teams to translate needs into ML improvements.

Benefits

  • Medical, dental, and vision coverage
  • Employer-paid life and disability insurance
  • Flexible time off with generous company wide holidays
  • Paid parental leave
  • Educational assistance program
  • Commuter benefits, including bike share memberships for office based employees
  • Company subsidized lunch program

About the company

Lila Sciences is building Scientific Superintelligence™ to solve humankind's greatest challenges. The company builds systems that can learn for themselves by combining advanced AI models with proprietary AI Science Factory™ instruments.

Senior / Staff Machine Learning Engineer, Applied AI at Lilasciences | JobZoey