Staff Software Engineer, Production Engineering

The role

You will build and operate production infrastructure including compute, networking, Kubernetes, and workflow orchestration. You will improve the reliability, scalability, security, and efficiency of the infrastructure platform to support AI workloads.

What you will do

• Design, build, and operate production infrastructure for products and AI workloads.
• Drive technical direction for compute, networking, Kubernetes, and workflow orchestration.
• Lead cross-functional technical initiatives for reliability, scalability, and security.
• Partner with Product Engineering, Security, AI Infrastructure, and Platform teams.
• Establish reusable patterns, tooling, and paved paths for engineering teams.
• Raise the engineering bar through design reviews, documentation, and mentorship.
• Build and operate global compute and network infrastructure.
• Improve compute utilization, performance, and service availability.
• Develop capacity models, demand forecasts, and fleet lifecycle automation.
• Operate and improve the Kubernetes platform.

Required qualifications

• 10+ years of software, infrastructure, site reliability, or production engineering experience.
• Deep experience building and operating large-scale cloud infrastructure on AWS, Azure, or Google Cloud Platform.
• Strong hands-on experience operating Kubernetes in production.
• Experience building and operating distributed systems.
• Experience with infrastructure automation and Infrastructure-as-Code using tools such as Terraform or Pulumi.
• Strong understanding of compute infrastructure, networking, capacity planning, fleet management, and production operations.
• Experience designing and operating observability systems.
• Strong understanding of infrastructure security, including IAM, network security, secrets management, and compliance best practices.
• Track record of driving complex, cross-functional technical initiatives and influencing engineering decisions.
• Excellent communication skills.
• A systems-thinking mindset.

Nice to have

• Experience supporting AI/ML or LLM infrastructure at scale.
• Experience operating GPU fleets, high-performance compute infrastructure, or large-scale capacity planning.
• Experience with multi-cloud infrastructure or hybrid cloud environments.
• Experience building internal platforms or developer tooling.

About the company

Harvey is transforming how legal and professional services operate by combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise.