Generalist
Software Engineer: ML Optimization
San Francisco Bay Area (San Mateo). Posted 9 months ago
The role
You will own optimizations on both the training and on-robot inference stacks. You will implement ML, hardware, and software changes to achieve step-function gains.
What you will do
- Make GPUs go brrrrr
- Implement ML, hardware, and software changes that lead to step-function gains
- Optimize both the inference and training stacks
Required qualifications
- Proficient and stay current with the latest ML techniques for training and inference optimizations in transformer and diffusion based architectures
- Chase ML optimizations from CUDA kernels, ML architecture, frontend or backend network bottlenecks, CPU bottlenecks, NVLink and comms, to torch, numpy, and Python inefficiencies
About the company
Generalist is on a mission to build general intelligence for the physical world. They build embodied foundation models with a focus on dexterity.