Generalist
Software Engineer: ML Infra
Boston (Somerville). Posted 9 days ago
The role
This person will own GPU compute fleets and inference infrastructure. They will optimize ML data loading, storage, and orchestration for robot inference fleets.
What you will do
- Owning our GPU compute fleets
- Ensure our GPUs are easy for researchers to use and maximally utilized
- Optimizing and improving ML data loading transport and storage in highly distributed fully utilized environments
- Orchestration of robot inference fleets
Required qualifications
- Managed large fleets of GPUs doing large-scale, long-term, highly distributed training runs or inference
- Deep experience in Slurm or Kubernetes for ML workload orchestration
- Have build high-scale ML data loaders and preparation systems
- Deeply understand every layer of the ML hardware, storage, and networking stacks
- Have experience in the NVidia GPU ecosystem
About the company
Generalist builds embodied foundation models to enable robots to intelligently interact with the physical world. The team includes researchers and roboticists from OpenAI, Boston Dynamics, and Google DeepMind.