Generalist

Research Scientist: Post-Training

San Francisco Bay Area (San Mateo). Posted 2 months ago

The role

You will train large pretrained robot models into production-ready systems. This involves fine-tuning, reinforcement learning, steering, human feedback, task specialization, evaluation, and on-robot validation at scale.

What you will do

  • Designing fine-tuning and adaptation strategies for downstream robotic tasks and embodiments
  • Developing methods for improving reliability, robustness, and controllability
  • Building evaluation frameworks that measure real-world robot performance
  • Improving inference-time performance in collaboration with ML infrastructure
  • Leveraging techniques such as imitation learning, RL, distillation, synthetic data, and curriculum learning
  • Closing the loop between model outputs and physical-world outcomes

Required qualifications

  • Experience with fine-tuning large models for downstream tasks (RLHF, IL, RL, distillation, domain adaptation, etc.)
  • Experience working on embodied AI, robotics, or real-world ML systems
  • Ability to debug across the ML stack from loss curves to robot behavior

About the company

Generalist builds embodied foundation models with a focus on dexterity. The team includes researchers and roboticists from OpenAI, Boston Dynamics, and Google DeepMind.

Research Scientist: Post-Training at Generalist | JobZoey