Research Scientist (post-training)

The role

This Research Scientist will focus on alignment and post-training techniques for large-scale video generation models. You will ensure diffusion-based video models produce high-quality, physically accurate, and safe outputs.

What you will do

• Lead research initiatives in alignment and post-training methods for video generation models
• Design and implement supervised fine-tuning and reinforcement learning from human feedback (RLHF) pipelines
• Develop robust evaluation frameworks to measure model alignment, safety, and output quality
• Create and optimize data collection pipelines for human feedback and preferences
• Design and conduct experiments to validate alignment techniques and their scaling properties
• Collaborate with cross-functional teams to integrate alignment improvements into production
• Review academic literature in generative AI and alignment
• Mentor junior researchers
• Work with product teams to ensure alignment methods enhance model capabilities

Required qualifications

• Ph.D. in Computer Science, Artificial Intelligence, Machine Learning, or a closely related field
• Strong publication record in top-tier conferences (e.g., NeurIPS, ICML, ICLR) with a focus on reinforcement learning, alignment, or generative models
• Extensive experience implementing and optimizing large-scale training pipelines using PyTorch
• Deep understanding of reinforcement learning techniques, particularly RLHF
• Experience with distributed training systems and large-scale experiments
• Proven track record in designing and implementing robust evaluation frameworks
• Excellent communication skills
• Strong software engineering skills and experience with complex shared codebases

Nice to have

• Experience with diffusion models or other generative architectures
• Background in fine-tuning large language models or generative models
• Experience working with human feedback data collection and annotation pipelines
• Strong aesthetic sense and understanding of video quality assessment
• Familiarity with alignment techniques such as constitutional AI or debate
• Track record of successful collaboration with product teams
• Experience with perceptual quality metrics and human evaluation design
• Contributions to open-source projects in AI alignment or generative AI

About the company

Genmo is a research lab developing video world models to understand, simulate, and interact with the physical world. Their mission is to unlock the right brain of AGI.