AI Automation Engineer, Real-World Test Lab

The role

You will design and own automation that executes Lab evaluations end to end. You will build systems to produce evidence for spatial AI models and services.

What you will do

• Own the automation that executes Lab evaluations end to end
• Instrument scorecards to compare results across product versions, devices, and capture conditions
• Build agent workflows that exercise priority customer use cases
• Convert one-off experiments into standing protocols that run on every relevant release
• Produce precise diagnostics for findings
• Work with the AI Data Manager to ensure runs are reproducible from a known dataset state

Required qualifications

• Built and maintained production-grade automation or test infrastructure
• Experience evaluating systems where correctness is graded rather than binary
• Strong Python, with fluency in orchestration, CI-style pipelines, cloud storage, and reproducible environments
• Worked with backend services and APIs you did not own
• Written up a technical finding clearly enough that a non-author could act on it without a meeting
• A bachelor's degree in a relevant field, or equivalent experience

Nice to have

• Built agent-based or LLM-driven automation for a task that previously required human judgment
• Worked on evaluation or benchmarking for computer vision, 3D reconstruction, or spatial systems
• Instrumented dashboards or scorecards that leadership used for release decisions
• Operated data provisioning or registry infrastructure across multiple environments and access models

Benefits

• Medical coverage
• Dental coverage
• Vision coverage
• 401(k)
• Comprehensive benefits package

About the company

Niantic Spatial builds spatial AI models and services so people and machines can reason, learn and act safely in the physical world. They turn camera imagery, video, sensor data and archives into accurate, AI-readable representations of real places.