Chakra Labs
Member of Technical Staff, Applied Research
New York. Posted 18 months ago
The role
You will design and run model improvement workflows, including supervised fine-tuning, preference optimization, and reinforcement learning. You will also build environments, tasks, reward systems, and research infrastructure for frontier AI labs.
What you will do
- Design and run model improvement workflows across supervised fine-tuning, preference optimization, and reinforcement learning.
- Design tasks, tools, validators, reward signals, and evaluation harnesses.
- Create, inspect, and improve data for teaching models how to behave.
- Work on reward functions, rubrics, validators, and analysis tools.
- Run experiments across distributed GPU clusters.
- Work with PyTorch and FSDP.
- Build infrastructure for model training, evaluation, and data generation at scale.
- Translate ambiguous research goals into concrete environments, datasets, experiments, and deliverables.
Required qualifications
- Masters / PhD-level knowledge of machine learning fundamentals.
- Understand linear algebra, optimization, and stochastic gradient descent.
- Worked with or deeply understand LLM fine-tuning, preference data, reward modeling, or reinforcement learning for language models.
- Strong in Python.
- Comfortable building with PyTorch and FastAPI.
- Comfortable with modern ML infrastructure.
Nice to have
- Roughly 3-5 years of experience
About the company
Chakra Labs builds high-fidelity environments, evals, and datasets for frontier AI research. The team consists of ex-Stripe, Snap, AWS, Microsoft, and Airtable members.