ML Research Scientist, Scientific Evaluations

The role

The ML Research Scientist will build scientific problems and environments to evaluate frontier LLMs. This includes designing new evals, inventing RL environments, and building pipelines for synthetic environment generation.

What you will do

• Design and prototype new evals and environments for science
• Identify environment failures and patch model capability gaps
• Invent new types of RL environments
• Build end-to-end pipelines for synthetic environment generation
• Prototype and validate environment designs

Required qualifications

• Experience applying ML or computation to biology, chemistry, or material sciences
• A strong track record of creating environments or evaluations for model training
• Experience building large, complex data pipelines for model training or production
• Strong prototyping and coding skills in Python
• Creativity and research intuition
• Solid software engineering fundamentals

Nice to have

• Demonstrated experience training large language models
• Strong publication track record at conferences such as NeurIPS, ICML, and ICLR
• Strong Python programming skills, including research and production infrastructure
• Familiarity with distributed compute (Ray, Modal) or LLM inference systems (vLLM, batching strategies)
• Experience with async Python, Pydantic, and workflow orchestration frameworks (Flyte, Airflow)

Benefits

• Medical, dental, and vision coverage
• Employer-paid life and disability insurance
• Flexible time off with generous company wide holidays
• Paid parental leave
• Educational assistance program
• Commuter benefits
• Company subsidized lunch program

About the company

Lila Sciences is building Scientific Superintelligence™ to solve humankind's greatest challenges. The company combines advanced AI models with proprietary AI Science Factory™ instruments into an operating system for science.