Machine Learning Engineer - Vision Foundation Models

The role

You will design, train, and evaluate vision models that understand passengers, objects, and behaviors inside the vehicle. You will own a model area end to end, from data curation to deployment, and work with product, operations, safety, and vehicle software teams.

What you will do

• Design, train, and evaluate vision models for detection, pose, and action recognition inside the vehicle
• Own a model or feature area end to end: curate data, define labeling guidelines, train, evaluate, and deploy
• Set the quality bar for owned models using rigorous evaluation and error analysis
• Deploy models under real-time and compute constraints shared with the onboard perception system
• Partner across product, operations, safety, and vehicle software to define model specifications, metrics, and validation plans

Required qualifications

• MS or PhD in Computer Science, Machine Learning, Computer Vision, or a related field, with 6+ years of industry experience (PhD with 3+ years)
• Deep expertise in computer vision and deep learning for image and video understanding: object detection, pose and action recognition, fine-grained classification
• Hands-on experience with modern architectures such as convolutional and vision-transformer detectors, and self-supervised or foundation-model backbones such as DINOv3
• Strong proficiency in Python and PyTorch
• Experience with vision-language models or foundation-model backbones, and with auto-labeling or synthetic data for long-tail and rare classes
• Track record of owning the full ML lifecycle on real-world data: dataset curation, labeling guidelines, training, metric design (precision, recall, false-positive rate at an operating point), and erro

Nice to have

• Experience with in-cabin or occupant monitoring systems, ideally with multi-camera or fisheye imagery and low-light conditions
• Experience deploying deep learning models to real-time, resource-constrained systems with TensorRT, ONNX, or similar
• Proficiency in C++ for model integration

Before you apply

• You do not need to match every listed expectation to apply

About the company

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem to bring it to market. It aims to provide next-generation mobility-as-a-service in urban environments.