Research Scientist - World-Action Foundation Model, Robotics

The role

Research Scientists will conduct research on pretraining world-action foundation models using vision and physics modalities. They will work on topics like 3D vision, Gaussian splatting, and world foundation models to support autonomous driving and robotic systems.

What you will do

• Conduct research on pretraining world-action foundation model with various world modalities
• Dive into topics such as vision-physics modality association, feed-forward Gaussian splatting, and world foundation model
• Research 3D/world-action foundation models and multi-modal pretraining
• Work closely with other Research Scientists and interns on research publications for submission to top-tier conferences
• Collaborate with Research Engineers and engineering teams to test and deploy algorithms

Required qualifications

• Strong research record in the fields of 3D vision, reconstruction and generation for robotics and autonomous systems
• Publications in top-tier conferences or journals in the fields of computer vision, machine learning, and robotics
• MSc or PhD in machine learning and computer vision with autonomy and robotics applications or closely-related fields
• 1+ year of research experience in autonomy, self-driving, robotics, or related field
• Strong research skills and the ability to work both independently and collaboratively on projects
• Technical experience in Python
• Technical experience in Pytorch
• Technical experience in computer vision
• Technical experience in robotics systems
• Technical experience in distributed machine learning model training

Nice to have

• Hands-on experience in 3D foundation model and pretraining
• Hands-on experience in Multi-modal foundation model
• Hands-on experience in Feed-forward Gaussian splatting and reconstruction
• Hands-on experience in World foundation model and generation
• Hands-on experience in 3D/multi-view end-to-end models for autonomous driving or robotics
• Hands-on experience in Human data processing and incorporation

Benefits

• Base salary
• Equity in the form of options and/or restricted stock units
• Comprehensive health, dental, vision, life and disability insurance coverage
• 401k retirement benefits with employer match
• Learning and wellness stipends
• Paid time off

About the company

Applied Intuition, Inc. is a Silicon Valley company creating digital infrastructure for physical AI. It services the automotive, defense, trucking, construction, mining and agriculture industries.