Zoox
Senior/Staff Software Engineer, HPC
Foster City, CA. Posted 3 months ago
The role
You will build, scale and operate Zoox's custom high-performance computing infrastructure. The platform supports compute, storage and scheduling for software teams across the company, including AI model training and simulation.
What you will do
- Design and implement core services and abstractions for distributed compute infrastructure supporting hundreds of thousands of concurrent jobs
- Work with customer and infrastructure teams to build a multiyear software engineering roadmap for the HPC platform
- Lead multi-quarter, cross-team initiatives that drive org-wide improvements
- Create production-grade APIs, SDKs and tools for running large-scale distributed workloads
- Design and improve job scheduling algorithms and auto-scaling policies
- Design multi-region orchestration strategies for data locality, reliability and performance
- Identify and resolve systemic reliability and performance issues through profiling and analysis
- Evaluate new technologies that improve computational and storage capabilities
- Develop capacity planning tools and forecasting models
- Mentor junior engineers
Required qualifications
- Experience designing and operating large-scale distributed systems in production
- Experience with Ray.io, particularly Ray Core and Ray Data (or equivalent technologies)
- Experience with Kubernetes, particularly for heterogeneous workloads
- Experience with cloud infrastructure on AWS or similar providers
- Track record of shipping and operating reliable, highly available scalable infrastructure
- Demonstrated ability to prioritize development work and build cross-functional consensus around technical tradeoffs
- Proficiency with Python
Nice to have
- Exposure to machine learning workloads (training, inference, data generation)
- Experience with Kubernetes or SLURM at scale (>10k+ nodes)
- Experience with SLURM workload manager and advanced scheduling policies
- Background in algorithmic optimization or operations research
- Experience building developer tools and platforms used by large engineering organizations
About the company
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem to bring this technology to market. It aims to provide next-generation mobility-as-a-service in urban environments.