Generalist
Research Scientist: Post-Training
San Francisco Bay Area (San Mateo). Posted 2 months ago
The role
You will train large pretrained robot models into production-ready systems. This involves fine-tuning, reinforcement learning, steering, human feedback, task specialization, evaluation, and on-robot validation at scale.
What you will do
- Designing fine-tuning and adaptation strategies for downstream robotic tasks and embodiments
- Developing methods for improving reliability, robustness, and controllability
- Building evaluation frameworks that measure real-world robot performance
- Improving inference-time performance in collaboration with ML infrastructure
- Leveraging techniques such as imitation learning, RL, distillation, synthetic data, and curriculum learning
- Closing the loop between model outputs and physical-world outcomes
Required qualifications
- Experience with fine-tuning large models for downstream tasks (RLHF, IL, RL, distillation, domain adaptation, etc.)
- Experience working on embodied AI, robotics, or real-world ML systems
- Ability to debug across the ML stack from loss curves to robot behavior
About the company
Generalist builds embodied foundation models with a focus on dexterity. The team includes researchers and roboticists from OpenAI, Boston Dynamics, and Google DeepMind.