Harvey

Staff Software Engineer, Agents

New York, Remote. Posted 3 months ago

The role

You will build systems that make AI agents indispensable to legal professionals. You will design environments and actions for agentic professional work, manage model selection, and develop evaluations to unlock new capabilities.

What you will do

  • Partner with customers and PMs to understand legal workflows and design practical evaluations.
  • Ship agents that get the job done.
  • Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
  • Work with model infra team to design and implement infrastructure for low-latency agent execution.
  • Improve observability and instrumentation to profile agent behavior and drive optimization decisions.
  • Stay current on new developments in agentic systems.

Required qualifications

  • 10+ years (post-BS/MS) of software engineering experience.
  • Passion for building effective domain-specific agents.
  • Iterative mindset: develop proof of concepts, make decisions quickly, and ship v0s.
  • Comfortable with when and how to use evaluations to drive quality.
  • Humble and adaptable about code and frameworks.
  • Proficiency in Python.
  • Experience working with LLM APIs and agent frameworks.
  • Experience with shipping user-facing products, either on the backend or full-stack.

About the company

Harvey is transforming how legal and professional services operate by combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise.

Staff Software Engineer, Agents at Harvey | JobZoey