Harvey

Staff Software Engineer, Core Infrastructure

San Francisco. Posted 6 months ago

The role

You will design and build scalable, fault-tolerant infrastructure systems for an AI platform. You will own multi-cloud infrastructure, lead technical initiatives for observability and incident response, and mentor engineers.

What you will do

  • Design and build scalable, fault-tolerant infrastructure systems
  • Own and evolve multi-cloud infrastructure including Kubernetes, networking, and container management
  • Lead technical initiatives around observability, incident response, and operational excellence
  • Architect and optimize distributed systems for reliability
  • Partner with Product Engineering and Security teams
  • Drive infrastructure-as-code practices using Terraform and Pulumi
  • Mentor engineers and raise the technical bar through code and design reviews

Required qualifications

  • 10+ years of experience in Infrastructure Engineering or Platform Engineering in a production environment
  • Long track record building and scaling complex, large-scale distributed systems
  • Deep proficiency with cloud infrastructure platforms
  • Strong fluency in Infrastructure as Code (IaC) tools — Terraform, Pulumi, or CloudFormation
  • Solid understanding of Kubernetes, container orchestration, networking, and cloud security at scale
  • Experience with observability tools (Datadog, Sentry) and incident response practices (PagerDuty, Incident.io)
  • Strong programming skills in Python, Go, or similar languages
  • Excellent problem-solving skills

Nice to have

  • Experience building infrastructure for AI/ML workloads or high-throughput inference systems
  • Background with distributed rate limiting, load balancing, or quota management systems
  • Experience operating multi-tenant platforms with strict security and compliance requirements
  • Track record of leading complex cross-functional projects and delivering measurable impact

Benefits

  • Relocation assistance

About the company

Harvey is transforming how legal and professional services operate by combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise.

Staff Software Engineer, Core Infrastructure at Harvey | JobZoey