Member of Technical Staff - Pre-Training

The role

This person will research and build solutions across algorithms, scaling laws, data processing, optimizers, and model architecture. They will design scientific experiments to advance understanding of scaling large language models and data efficiency.

What you will do

• Research and build solutions across algorithms, scaling laws, data processing, optimizers, and model architecture.
• Design and run scientific experiments to advance understanding of scaling large language models and data efficiency.
• Implement state-of-the-art methods from the deep learning literature.
• Lead small research projects independently while collaborating on larger initiatives.
• Optimize the training infrastructure for efficient scaling.
• Contribute across the entire stack, from low-level optimizations to high-level model design.

Required qualifications

• Graduate degree (MS or PhD) in Computer Science, Machine Learning, or related discipline.
• Solid software engineering capabilities with experience building large-scale systems.
• Experience with large-scale ETL workflows and training data preparation.
• Deep understanding of large-scale ML, especially as it relates to language models, distributed training, and scaling.
• Proficient in Python and deep learning frameworks.
• Navigate trade-offs between research objectives and practical engineering realities.
• Thrive in a fast-paced, high-agency startup environment with bias toward action.
• Strong communication capabilities and comfort working collaboratively.
• Passionate about advancing the frontier of intelligence.

Nice to have

• PyTorch preferred

Benefits

• Salary and equity
• Stock options
• Comprehensive medical, dental, vision, and life
• Annual wellness allowance
• Lunch and dinner provided in the office daily
• 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys
• Unlimited paid time off in the U.S.
• 30 days paid time off in the U.K.
• Sponsorship support for visas
• Regular off-sites, happy hours, and team celebrations

Before you apply

• This position may require access to technology or source code subject to the U.S. Export Administration Regulations.
• Any offer of employment may be conditioned on the Company's ability to provide access to technology or source code in compliance with U.S. export control laws.

About the company

Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. They build open models to help shape the future of AI.