Generalist

Software Engineer: ML Infra

Boston (Somerville). Posted 9 days ago

The role

This person will own GPU compute fleets and inference infrastructure. They will optimize ML data loading, storage, and orchestration for robot inference fleets.

What you will do

  • Owning our GPU compute fleets
  • Ensure our GPUs are easy for researchers to use and maximally utilized
  • Optimizing and improving ML data loading transport and storage in highly distributed fully utilized environments
  • Orchestration of robot inference fleets

Required qualifications

  • Managed large fleets of GPUs doing large-scale, long-term, highly distributed training runs or inference
  • Deep experience in Slurm or Kubernetes for ML workload orchestration
  • Have build high-scale ML data loaders and preparation systems
  • Deeply understand every layer of the ML hardware, storage, and networking stacks
  • Have experience in the NVidia GPU ecosystem

About the company

Generalist builds embodied foundation models to enable robots to intelligently interact with the physical world. The team includes researchers and roboticists from OpenAI, Boston Dynamics, and Google DeepMind.

Software Engineer: ML Infra at Generalist | JobZoey