Member of Technical Staff, Production Site Reliability Engineer

The role

You will make vLLM-powered inference services dependable in production. You will own reliability across the production lifecycle, including release safety, observability, incident response, and capacity planning.

What you will do

• Own reliability across the production lifecycle
• Define SLOs around availability, latency, and successful inference requests
• Build monitoring to help engineers pinpoint failures
• Automate recurring operational work
• Drive mitigation, coordinate escalation, and lead post-mortems during incidents
• Partner with engineering on capacity planning and operational readiness

Required qualifications

• Bachelor's degree or equivalent experience in computer science, engineering, systems, infrastructure, or similar
• Hands-on experience building or operating production distributed systems, cloud infrastructure, or services
• Strong programming or scripting ability in Python, Go, Bash, or similar
• Experience responding to significant production incidents
• Practical understanding of service-level objectives (SLOs), service-level indicators (SLIs), error budgets, and alerting
• Strong Linux, networking, and systems debugging fundamentals

Nice to have

• Experience supporting AI inference, model serving, ML infrastructure, GPU workloads, or other latency-sensitive, high-throughput services
• Experience deploying, operating, and debugging Kubernetes-based services, with familiarity with Docker, Terraform, or comparable infrastructure tooling
• Experience building observability with metrics, logs, traces, dashboards, and actionable alerts across distributed systems
• Experience improving deployment safety and recovery through automation, testing, release gates, and rollback procedures
• Experience with resource scheduling, capacity planning, or workload isolation in multi-tenant cloud or GPU environments
• Owned reliability for an inference service or other mission-critical platform through a period of significant growth
• Built automation that measurably reduced operational toil, improved recovery time, or prevented repeat incidents
• Established practical SLOs, post-mortem processes, or production-readiness reviews

Benefits

• Health benefits
• Dental benefits
• Vision benefits
• 401(k) company match

Before you apply

• We sponsor visas on a case-by-case basis

About the company

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress. Founded by the creators and core maintainers of vLLM, the company sits at the intersection of models and hardware.