Senior Machine Learning Engineer - Foundation Model

The role

You will design, train and deploy large multi-modal models for XPENG's next-generation Vision-Language-Action foundation model. This model powers the company's end-to-end autonomous driving systems.

What you will do

• Design and implement large-scale multi-modal architectures, such as vision-language-action transformers, for end-to-end autonomous driving.
• Develop pretraining and fine-tuning strategies using large labeled and unlabeled fleet data.
• Research and integrate cross-modal alignment, including visual grounding, temporal reasoning, policy distillation, imitation and reinforcement learning.
• Collaborate with infrastructure engineers to scale training across thousands of GPUs using distributed training frameworks.
• Conduct systematic ablation, evaluation and visualization of model behavior across perception, reasoning and planning tasks.
• Contribute to model deployment optimization, including quantization, export and latency-accuracy trade-offs for onboard execution.

Required qualifications

• Master's degree or higher in Computer Science, Electrical/Computer Engineering, or a related field.
• 3+ years of experience in deep learning research or productization.
• Strong proficiency in PyTorch and modern transformer-based model design.
• Experience in large-scale pretraining or multi-modal modeling (vision, language or planning).
• Deep understanding of representation learning, temporal modeling, and self-supervised or reinforcement learning techniques.
• Familiarity with distributed training (DDP, FSDP) and large-batch optimization.

Nice to have

• PhD in CS, CE, EE or a related field, with 1+ years of relevant industry experience.
• Publication record in top-tier AI conferences (CVPR, ICCV, NeurIPS, ICLR, ICML, ECCV).
• Prior experience building foundation or end-to-end driving models, or LLM/VLM architectures.
• Familiarity with RLHF/DPO/GRPO, trajectory prediction, or policy learning for control tasks.
• Proven ability to collaborate cross-functionally with infrastructure, perception and planning teams to deliver production-ready models.

Benefits

• A collaborative, research-driven environment with access to massive real-world data and industry-scale compute.
• Opportunity to work with top-tier researchers and engineers on foundation models for autonomous driving.
• Direct impact on the next generation of intelligent mobility systems.
• Competitive compensation package.
• Snacks, lunches, dinners and fun activities.

Before you apply

• Salary is determined by work location and factors including job-related skills, experience, and relevant education or training.

About the company

XPENG is a smart technology company integrating AI and autonomous driving into electric vehicles, eVTOL aircraft and robotics. It focuses on reshaping the future of transportation through R&D in AI, machine learning and smart connectivity.