Staff Software Engineer

The role

You will design and build scalable backend infrastructure systems for an AI platform. You will own multi-cloud infrastructure and lead technical initiatives for observability and operational excellence.

What you will do

• Design and build scalable, fault-tolerant backend infrastructure systems
• Own and evolve multi-cloud infrastructure including Kubernetes, networking, and container management
• Lead technical initiatives around observability, incident response, and operational excellence
• Architect and optimize distributed systems for reliability
• Partner with Product Engineering and Security teams
• Drive infrastructure-as-code practices using Terraform and Pulumi
• Mentor engineers through code reviews, design reviews, and technical leadership
• Design and implement a next-generation model proxy architecture
• Build distributed rate limiting and quota management systems
• Architect multi-region deployment strategies

Required qualifications

• 10+ years of experience in Infrastructure Engineering or Platform Engineering in a production environment
• Long track record building and scaling complex, large-scale distributed systems
• Deep proficiency with cloud infrastructure platforms
• Strong fluency in Infrastructure as Code (IaC) tools — Terraform, Pulumi, or CloudFormation
• Solid understanding of Kubernetes, container orchestration, networking, and cloud security at scale
• Experience with observability tools (Datadog, Sentry) and incident response practices (PagerDuty, Incident.io)
• Strong programming skills in Python, Go, or similar languages
• Excellent problem-solving skills

Nice to have

• Experience building infrastructure for AI/ML workloads or high-throughput inference systems
• Background with distributed rate limiting, load balancing, or quota management systems
• Experience operating multi-tenant platforms with strict security and compliance requirements
• Track record of leading complex cross-functional projects and delivering measurable impact
• Azure experience

Before you apply

• Must be authorized to work in India
• Visa sponsorship is not available

About the company

Harvey is transforming how legal and professional services operate by combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise.