Senior Staff Machine Learning Engineer - Perception

The role

You will lead development of machine learning algorithms for the perception system of autonomous vehicles, covering scene understanding, segmentation, tracking and classification. You will work across teams on Prediction, Planning, Simulation and Safety Validation, and mentor other ML developers.

What you will do

• Develop new algorithms to understand the scene around the robot and how it evolves through time
• Build multi-modal foundation models for on-vehicle and offline applications
• Develop new algorithms to apply generative AI to simulation to improve offline validation realism
• Leverage large-scale machine learning infrastructure to discover new solutions
• Provide technical mentorship to the broader group of ML developers at Zoox
• Collaborate with Prediction, Planning and Simulation engineers on autonomous driving in complex urban environments

Required qualifications

• BS, MS, or PhD degree in computer science or a related field
• Experience training and deploying Deep Learning models on sensor data
• Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines
• Experience with modern computer vision techniques
• Strong mathematical skills and understanding of probabilistic techniques
• Fluency in C++, or fluency in Python with a basic understanding of C++
• Extensive experience with programming and algorithm design

Nice to have

• Publications in your field (CVPR, ICCV, RSS, ICRA preferred)
• Experience with autonomous robots
• Experience with realtime sensor fusion (e.g. LiDAR, camera, radar)
• Experience with novel pipelines and architectures for convolutional neural nets
• Experience with 3D data and representations (pointclouds, meshes, etc.)

Before you apply

• You do not need to match every listed expectation to apply

About the company

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem to bring it to market. It works at the intersection of robotics, machine learning and design to provide mobility-as-a-service in urban environments.