Research Engineer / Research Scientist, Tokens

The role

You will build large scale ML systems from the ground up. You will touch all parts of code and infrastructure, including improving cluster reliability, throughput, efficiency, designing scientific experiments, and improving dev tooling.

What you will do

• Making the cluster more reliable for big jobs
• Improving throughput and efficiency
• Running and designing scientific experiments
• Improving dev tooling
• Optimizing the throughput of a new attention mechanism
• Comparing the compute efficiency of two Transformer variants
• Making a Wikipedia dataset in a format models can easily consume
• Scaling a distributed training job to thousands of GPUs
• Writing a design doc for fault tolerance strategies
• Creating an interactive visualization of attention between tokens in a language model

Required qualifications

• Significant software engineering experience
• Bachelor’s degree or an equivalent combination of education, training, and/or experience
• A field relevant to the role as demonstrated through coursework, training, or professional experience

Nice to have

• High performance, large-scale ML systems
• GPUs, Kubernetes, Pytorch, or OS internals
• Language modeling with transformers
• Reinforcement learning
• Large-scale ETL

Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space

Before you apply

• This is an evergreen role and you may not hear back if there is no open role matching your skills
• We suggest reapplying only once per year
• We sponsor visas, but cannot sponsor every role or candidate

About the company

Anthropic is a public benefit corporation headquartered in San Francisco. Its mission is to create reliable, interpretable, and steerable AI systems.