Senior, ML Engineer - VLM

The role

You will own the offline dataset pipeline by designing and deploying cloud-based pipelines that convert multi-sensor data into VLM/VLA training datasets. You will build auto-labeling systems, mine long-tail scenarios, and partner with end-to-end model teams to close the data flywheel.

What you will do

• Own the offline dataset pipeline
• Build VLM-assisted auto-labeling
• Generate reasoning-grounded labels
• Mine and curate the long tail
• Close the data flywheel
• Partner with the end-to-end model team
• Scale on cloud infrastructure
• Lead and mentor engineers
• Stay current with multimodal model advances

Required qualifications

• Bachelor’s Degree in Computer Science, Robotics, Electrical Engineering, or related technical field plus 6+ years of experience; OR Master’s Degree in a related technical field plus 3+ years of experi
• Computer Vision & Deep Learning including model training and at least two of: 2D/3D Object Detection, Tracking, Sensor Fusion, Semantic Segmentation, BEV, Depth Estimation
• Multimodal / VLM experience with vision-language models, open-vocabulary or zero-shot recognition, dense captioning, or semantic embeddings / search
• Model Data Curation including building targeted datasets and large-scale Parquet data processing (Databricks, Daft, Pandas, etc.)
• Distributed ML & data frameworks such as PyTorch, Lightning, Ray, Spark, or equivalent
• Scaled MLOps & Tooling including experiment tracking, model registry, MLflow / Weights & Biases, and ML metrics, evaluation, and quality
• Strong Python software development
• VDI and cloud-based development environments
• CI systems (GitHub Actions)
• Docker

Nice to have

• End-to-end / VLA driving familiarity
• Auto-labeling foundation models experience
• High-throughput model serving (vLLM, SGLang)
• Semantic inference & retrieval experience
• AV data standards & tooling (Pegasus, ROS bags, MCAP, Parquet, Arrow)
• Cloud development & orchestration (Terraform, AWS managed services, AWS HyperPod / Anyscale)
• Data visualization (Foxglove, FiftyOne (51), three.js, OpenGL)
• Evaluation & research (closed-loop / open-loop evaluation frameworks, publications in top-tier CV/AI/Robotics venues)

Benefits

• Competitive compensation package including bonus and stock options
• 100% paid medical, dental, and vision premiums for full-time employees
• 401K plan with a 6% employer match
• Flexibility in schedule
• Generous paid vacation
• Company-wide holiday office closures
• AD+D and Life Insurance
• Potential sign-on payments and relocation

About the company

Torc is a leader in autonomous driving since 2007 and is now a part of the Daimler family. The company focuses on developing software for automated trucks to transform how the world moves freight.