Contract Student Worker – AI Validation and Benchmarking Engineer (40hrs / week Full-Time)

The role

You will support the validation pipeline for AI tools at Zoox. The work includes maintaining test datasets, running benchmarks, and measuring agent accuracy on routing decisions, classification labels, and structured outputs.

What you will do

• Run and maintain the benchmark pipeline and analyze results for routing errors and regressions
• Build and expand ground truth datasets to evaluate agent outputs
• Identify gaps in benchmark validation and help build a more comprehensive evaluation infrastructure
• Develop new evaluation dimensions such as label accuracy and structured output correctness
• Investigate failure modes in agent outputs and work with engineers on improvements
• Write scripts and tooling to automate data collection, result parsing and metric reporting
• Document findings, track benchmark trends over time and present results to the team

Required qualifications

• Currently enrolled in a B.S. or M.S. in Computer Science, Data Science, Engineering or a related field
• Available to commit to a minimum three-month assignment
• Able to commit to a minimum of 20 hours per week
• Able to work on-site at one of Zoox's office locations
• Must adhere to Zoox confidentiality requirements, including not using or sharing proprietary information outside Zoox, such as in academic research, theses, publications or presentations
• Familiar with Cursor or Claude
• Familiar with Python
• Familiar with evaluation concepts: precision, recall, F1 score and confusion matrices
• Comfortable working with structured data (CSV, JSON)
• Experience modifying or writing reproducible analysis scripts

Nice to have

• Prior exposure to LLM-based systems, prompt engineering or AI agent evaluation
• Experience with Jira or Slack

Benefits

• Benefits eligibility is determined by the vendor

Before you apply

• This is not an internship. The posting says the program has no structured intern programming and no pathway to full-time employment.
• Employment is through a vendor contracted with Zoox, not directly with Zoox.
• Applicants do not need to match every listed expectation.

About the company

Zoox is an autonomous ride-hailing company building a purpose-built, fully electric robotaxi with no steering wheel or driver's seat. It is backed by Amazon and operates in Las Vegas and San Francisco, with testing in seven U.S. markets.