Generalist

Software Engineer: ML Optimization

San Francisco Bay Area (San Mateo). Posted 9 months ago

The role

You will own optimizations on both the training and on-robot inference stacks. You will implement ML, hardware, and software changes to achieve step-function gains.

What you will do

  • Make GPUs go brrrrr
  • Implement ML, hardware, and software changes that lead to step-function gains
  • Optimize both the inference and training stacks

Required qualifications

  • Proficient and stay current with the latest ML techniques for training and inference optimizations in transformer and diffusion based architectures
  • Chase ML optimizations from CUDA kernels, ML architecture, frontend or backend network bottlenecks, CPU bottlenecks, NVLink and comms, to torch, numpy, and Python inefficiencies

About the company

Generalist is on a mission to build general intelligence for the physical world. They build embodied foundation models with a focus on dexterity.

Software Engineer: ML Optimization at Generalist | JobZoey