Generalist
Software Engineer: ML Infra
San Francisco Bay Area (San Mateo). Posted 9 months ago
The role
You will own GPU compute fleets and ensure they are easy for researchers to use and maximally utilized. You will also optimize ML data loading transport and storage and orchestrate robot inference fleets.
What you will do
- Owning our GPU compute fleets
- Ensure our GPUs are easy for researchers to use and maximally utilized
- Optimizing and improving ML data loading transport and storage in highly distributed fully utilized environments
- Orchestration of robot inference fleets
Nice to have
- Managed large fleets of GPUs doing large-scale, long-term, highly distributed training runs or inference
- Deep experience in Slurm or Kubernetes for ML workload orchestration
- Have build high-scale ML data loaders and preparation systems
- Deeply understand every layer of the ML hardware, storage, and networking stacks
- Have experience in the NVidia GPU ecosystem
About the company
Generalist is on a mission to build general intelligence for the physical world. They build embodied foundation models with a focus on dexterity.