Anthropic

[C] Research Engineer, Discovery

San Francisco, CA | New York City, NY. Posted 3 days ago

The role

You will work end to end across the whole model stack to identify and address infrastructure blockers. You will design and implement large-scale infrastructure systems to support AI scientist training, evaluation, and deployment.

What you will do

  • Design and implement large-scale infrastructure systems to support AI scientist training, evaluation, and deployment across distributed environments
  • Identify and resolve infrastructure bottlenecks impeding progress toward scientific capabilities
  • Develop robust and reliable evaluation frameworks for measuring progress towards scientific AGI
  • Build scalable and performant VM/sandboxing/container architectures to safely execute long-horizon AI tasks and scientific workflows
  • Collaborate to translate experimental requirements into production-ready infrastructure
  • Develop large scale data pipelines to handle advanced language model training requirements
  • Optimize large scale training and inference pipelines for stable and efficient reinforcement learning

Required qualifications

  • 6+ years of highly-relevant experience in infrastructure engineering with demonstrated expertise in large-scale distributed systems
  • Strong communicator
  • Deep knowledge of performance optimization techniques and system architectures for high-throughput ML workloads
  • Experience with containerization technologies (Docker, Kubernetes) and orchestration at scale
  • Proven track record of building large-scale data pipelines and distributed storage systems
  • Excel at diagnosing and resolving complex infrastructure challenges in production environments
  • Can work effectively across the full ML stack from data pipelines to performance optimization
  • Experience collaborating with other researchers to scale experimental ideas
  • Thrive in fast-paced environments and can rapidly iterate from experimentation to production
  • Bachelor’s degree or an equivalent combination of education, training, and/or experience
  • A field relevant to the role as demonstrated through coursework, training, or professional experience

Nice to have

  • Experience with language model training infrastructure and distributed ML frameworks (PyTorch, JAX, etc.)
  • Background in building infrastructure for AI research labs or large-scale ML organizations
  • Knowledge of GPU/TPU architectures and language model inference optimization
  • Experience with cloud platforms (AWS, GCP) at enterprise scale
  • Familiarity with VM and container orchestration
  • Experience with workflow orchestration tools and experiment management systems
  • History working with large scale reinforcement learning
  • Comfort with large scale data pipelines (Beam, Spark, Dask, …)

Benefits

  • Competitive compensation and benefits
  • Optional equity donation matching
  • Generous vacation and parental leave
  • Flexible working hours
  • A lovely office space

Before you apply

  • We do sponsor visas, but we aren't able to successfully sponsor visas for every role and every candidate

About the company

Anthropic is a public benefit corporation headquartered in San Francisco. Their mission is to create reliable, interpretable, and steerable AI systems.

[C] Research Engineer, Discovery at Anthropic | JobZoey