Zoox

Senior/Staff Software Engineer, HPC

Foster City, CA. Posted 3 months ago

The role

You will build, scale and operate Zoox's custom high-performance computing infrastructure. The platform supports compute, storage and scheduling for software teams across the company, including AI model training and simulation.

What you will do

  • Design and implement core services and abstractions for distributed compute infrastructure supporting hundreds of thousands of concurrent jobs
  • Work with customer and infrastructure teams to build a multiyear software engineering roadmap for the HPC platform
  • Lead multi-quarter, cross-team initiatives that drive org-wide improvements
  • Create production-grade APIs, SDKs and tools for running large-scale distributed workloads
  • Design and improve job scheduling algorithms and auto-scaling policies
  • Design multi-region orchestration strategies for data locality, reliability and performance
  • Identify and resolve systemic reliability and performance issues through profiling and analysis
  • Evaluate new technologies that improve computational and storage capabilities
  • Develop capacity planning tools and forecasting models
  • Mentor junior engineers

Required qualifications

  • Experience designing and operating large-scale distributed systems in production
  • Experience with Ray.io, particularly Ray Core and Ray Data (or equivalent technologies)
  • Experience with Kubernetes, particularly for heterogeneous workloads
  • Experience with cloud infrastructure on AWS or similar providers
  • Track record of shipping and operating reliable, highly available scalable infrastructure
  • Demonstrated ability to prioritize development work and build cross-functional consensus around technical tradeoffs
  • Proficiency with Python

Nice to have

  • Exposure to machine learning workloads (training, inference, data generation)
  • Experience with Kubernetes or SLURM at scale (>10k+ nodes)
  • Experience with SLURM workload manager and advanced scheduling policies
  • Background in algorithmic optimization or operations research
  • Experience building developer tools and platforms used by large engineering organizations

About the company

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem to bring this technology to market. It aims to provide next-generation mobility-as-a-service in urban environments.

Senior/Staff Software Engineer, HPC at Zoox | JobZoey