Model Engineer, RL Data

The role

You will drive effective RL or mid-training research in a small-team setting. You will own research problems end-to-end by forming hypotheses, designing experiments, and building training, eval, and data to push results into the next model.

What you will do

• Design and run rigorous experiments that turn research ideas into measurable gains in model capability
• Improve data recipes through data quality, deduplication, and mixture experiments
• Define what makes RL data and rewards good, including grader design and preventing reward hacking
• Advance training science, from architecture and scaling experiments to post-training recipes for coding and computer-use agents
• Build evals and targeted tasks that expose model weaknesses and guide where the team invests next
• Partner with engineers to take promising results from small experiments to frontier-scale training runs

Required qualifications

• Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
• Must be able to work in person at the Palo Alto office

Nice to have

• Able to handle ambiguous research tasks with little guidance, and to own a research direction end to end
• Care an unusual amount about data quality, and can dive into the data when appropriate
• Truth seeking, aiming to learn more about the science than to prove your ideas are correct
• Experience with RL algorithms for language models, scaling laws, or building RL environments and evals
• Experience with distributed training at scale and debugging problems that only show up at scale
• Experience training frontier-scale models
• Strong background in RL and machine learning fundamentals
• An excellent programmer and software engineer, comfortable working across the research stack in Python and PyTorch or JAX
• Hands-on experience training large models, through pretraining, post-training or RL
• A track record of original work in ML, such as new methods or real improvements, shown through research, open source or production impact

Benefits

• Equity
• Comprehensive medical, vision, and dental coverage
• Access to a 401(k) retirement plan
• Short & long-term disability insurance
• Life insurance
• Various other discounts and perks

About the company

SpaceXSI is building Super Intelligence to help humanity understand the universe. They are building the full Super Intelligence stack, from Colossus supercomputers to Grok models and applications.