Site Reliability Engineer

The role

You will define and codify gold standards for day 2 operations for an ML infrastructure platform. You will build robust systems, processes, automations, and observability tooling to keep the platform reliable at scale.

What you will do

• Own the reliability of Baseten's multi-cloud Kubernetes infrastructure.
• Build and maintain observability infrastructure as code.
• Author, validate, and improve runbooks for recurring failure patterns.
• Identify high-frequency failure patterns and convert them into automated mitigations.
• Diagnose and resolve runtime issues related to latency, memory, GPU utilization, concurrency, and model lifecycle management.
• Define and instrument SLOs and SLIs across customer workloads and internal services.
• Navigate ambiguity and make principled tradeoffs in systems and processes.

Required qualifications

• Extensive hands-on experience with Kubernetes.
• Experience in building and maintaining scalable infrastructure.
• Strong foundation in observability tooling: metrics (VictoriaMetrics, Prometheus), logging (Loki, ELK), dashboards (Grafana), and alerting pipelines.
• Experience with infrastructure-as-code (Terraform, Helm) and GitOps workflows (Flux CD, ArgoCD).
• Experience writing and improving runbooks, leading incident response, and doing post-mortem analysis.
• Comfort working at the intersection of engineering and operations.

Nice to have

• Multi-cloud experience across EKS, GKE, or similar
• Observability-as-code experience
• Familiarity with incident management platforms (incident.io or similar)
• Curiosity about how ML models are deployed and served at scale

Benefits

• Competitive compensation, including meaningful equity
• 100% coverage of medical, dental, and vision insurance for employee and dependents (U.S. only)
• Flexible PTO policy including company wide Winter Break
• Paid parental leave
• Fertility and family-building stipend through Carrot
• Company-facilitated 401(k) (U.S. only)
• Exposure to a variety of ML startups

About the company

Baseten powers mission-critical inference for AI companies by uniting applied AI research, flexible infrastructure, and seamless developer tooling. The company recently raised a $1.5B Series F.