Waabi
Systems Engineer - Behavior Verification
Remote US. Posted 20 days ago
The role
You will design and document the scenario and test sets that measure on-road behavior of autonomous driving software. You will also validate those test sets and decide which ones enter the release pipeline.
What you will do
- Design and document scenario and test sets that establish on-road behavior performance, from minimum to comprehensive.
- Define and run scenario validity checks, and approve or refuse test sets before they judge a release.
- Maintain quality feedback on scenarios, taggers, graders and the taxonomy behind them.
- Turn behavior requirements into testable criteria, working with Behavior Requirements on targets and acceptance criteria.
- Investigate behavior deficiencies, find further instances, establish exposure, and return them to the pipeline as test escapes.
- Distinguish genuine behavior failures from simulation artifacts, and raise simulation fidelity gaps with the relevant teams.
- Work across motion planning, simulation, evaluation, operations, safety methodology and platform teams.
- Align verification phases and cadence with the organization, including daily releases and significant steps in exposure.
Required qualifications
- Bachelor's or Master's degree in a relevant engineering or related field (e.g., Software Engineering, Electrical Engineering, Computer Science, Robotics, Advanced Controls, Aerospace).
- Experience verifying safety-critical systems, ideally in autonomous vehicles.
- Demonstrated experience designing test cases from requirements, and assessing what a test set covers and misses.
- Applied statistics: sample size, confidence, and what a result does and does not support.
- Proficiency in Python and the ability to navigate a large codebase.
- Familiarity with autonomous vehicle requirements, behaviors and design methodologies.
- Strong ability to structure, document and prioritize a large number of test sets and test strategies.
- Ability to work cross-functionally in a diplomatic way, across teams that do not always agree.
- A drive for commitment and accountability, for yourself and for others.
Nice to have
- Trucking or heavy-vehicle exposure.
- Machine learning experience, particularly model evaluation and false-positive / false-negative trade-offs.
- Exposure to regulatory frameworks: NHTSA, ISO 26262, SOTIF.
- Familiarity with tooling to extract coverage and exposure from large driving-log sets.
- Comfortable working in a newly formed team, where the process has to be built rather than followed.
Benefits
- Competitive compensation and equity awards.
- Medical, Dental and Vision coverage (full-time employees only).
- Unlimited vacation.
- Flexible hours and work-from-home support.
- Daily drinks, snacks and catered meals when in office.
- Regularly scheduled team building activities and social events, on-site, off-site and virtual.
About the company
Waabi, founded by Raquel Urtasun, develops Physical AI for autonomous trucks and robotaxis. It is backed by and partners with AI, automotive, logistics and deep tech leaders.