Staff Software Engineer, AI Platform

The role

This person will design and build abstractions and platform-level systems for agentic products. They will own infrastructure for model integration, routing, and evaluation to support all Harvey products.

What you will do

• Design and build abstractions and platform-level systems that improve all of Harvey’s agentic products.
• Own infrastructure for model integration, routing, and evaluation.
• Build evaluation frameworks and tooling for teams to iterate on AI quality.
• Partner with product engineering teams, PMs, and design to launch AI products.
• Evaluate, prototype, and integrate latest advancements in AI and agentic systems.

Required qualifications

• 10+ years of experience building backend systems
• At least 1+ year focused on AI/ML engineering
• Track record of technical leadership across teams
• Experience building and shipping multi-model or multi-provider AI systems in production
• Familiarity with context management, session state, or memory systems in AI or distributed systems
• Track record of building internal platforms, SDKs, or shared infrastructure that other engineering teams adopted
• Strong judgment about abstractions
• Excitement about agentic AI and the infrastructure challenges of making autonomous systems reliable
• A bias toward full ownership

Nice to have

• experience building evaluation frameworks
• working with agent/function-calling architectures
• familiarity with legal or other high-stakes professional services domains
• time at early-stage or hyper-growth startups where the underlying technology changes regularly

About the company

Harvey is transforming how legal and professional services operate by combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise.