Generalist

Software Engineer: ML Infra

San Francisco Bay Area (San Mateo). Posted 9 months ago

The role

You will own GPU compute fleets and ensure they are easy for researchers to use and maximally utilized. You will also optimize ML data loading transport and storage and orchestrate robot inference fleets.

What you will do

  • Owning our GPU compute fleets
  • Ensure our GPUs are easy for researchers to use and maximally utilized
  • Optimizing and improving ML data loading transport and storage in highly distributed fully utilized environments
  • Orchestration of robot inference fleets

Nice to have

  • Managed large fleets of GPUs doing large-scale, long-term, highly distributed training runs or inference
  • Deep experience in Slurm or Kubernetes for ML workload orchestration
  • Have build high-scale ML data loaders and preparation systems
  • Deeply understand every layer of the ML hardware, storage, and networking stacks
  • Have experience in the NVidia GPU ecosystem

About the company

Generalist is on a mission to build general intelligence for the physical world. They build embodied foundation models with a focus on dexterity.