Senior Machine Learning Engineer - AI Foundation

The role

You will help build the machine learning infrastructure for training very large foundation models used in autonomous driving and physical AI. The work covers training data pipelines, training frameworks, and speeding up model training and inference.

What you will do

• Design and implement training data pipelines that stream petabytes of labeled and unlabeled data from a fleet of over a million vehicles.
• Implement training frameworks for physical AI foundation models, including VLA 2.0, XWorld and Robotics.
• Accelerate training with parallelism methods such as FSDP, Expert Parallel and Context Parallel, and data types.
• Accelerate model inference on the cloud for closed-loop simulation, reinforcement learning and LLM/VLM applications.

Required qualifications

• Master's degree in CS, CE, EE or equivalent, or equivalent industry experience.
• Deep knowledge of PyTorch.
• Knowledge of a model inference framework such as vLLM or SGLang.
• In-depth knowledge of transformer architecture and ways to accelerate its training and inference.
• Experience performing large-scale distributed training of models.
• A track record of profiling models and improving training and inference speed.

Nice to have

• Previous experience in the autonomous driving industry.
• Experience with CUDA for writing custom ops.
• Experience with edge computing systems.
• Knowledge of distributed computing frameworks such as Ray.
• A track record of solving complex problems collaboratively on larger teams.

Benefits

• A fun, supportive and engaging environment.
• Infrastructure and computational resources to support your work.
• Opportunity to work on cutting-edge technologies with top talent in the field.
• Opportunity to make a significant impact on the transportation revolution by advancing autonomous driving.
• Competitive compensation package.
• Snacks, lunches, dinners and fun activities.

About the company

XPENG is a smart technology company integrating AI and autonomous driving into electric vehicles, eVTOL aircraft and robotics. Its mission is to solve the autonomous driving problem.