AI Engineer, Internal Systems

The role

You will build the verification and evaluation layer for agents to let them finish work with confidence. You will build verification loops, create testing environments, and operate the agent fleet as a production system.

What you will do

• Build end-to-end verification loops that let agents determine when their work is actually complete
• Create fast, reliable testing environments and turn failures and human feedback into durable evaluation signals
• Improve how context, instructions, skills, and memory are delivered to agents
• Measure what makes agents perform better
• Operate the agent fleet as a production system
• Measure agent quality, adoption, and impact

Required qualifications

• Built internal tools that other engineers adopted
• Can explain how internal tool impact was measured
• Use agentic coding tools deeply
• Have specific opinions about where agentic coding tools succeed and fail
• Built evaluation or verification infrastructure such as test harnesses, CI systems, eval pipelines, or benchmarks
• Can work hands-on across application code, infrastructure, and unfamiliar systems
• Are empirical about your own work
• Are attentive to subtle failure modes
• Are comfortable owning ambiguous problems

Nice to have

• Prior experience in voice
• Prior experience in model training
• Prior experience in our product domains

Before you apply

• We sponsor H1B, O1, EB1, L1, STEM OPT, and more
• We can't guarantee sponsorship for every role

About the company

Wispr is an AI research and product company building the voice interface for computing. They are building toward an interface that can perceive, understand, and take action with earned trust.