Senior Site Reliability Engineer

The role

You will build and improve Kubernetes infrastructure to scale a global GPU fleet. You will design systems for failure survivability, automate infrastructure through software, and develop observability tools.

What you will do

• Scale a global GPU fleet.
• Build and improve Kubernetes infrastructure for provisioning, networking, storage, and service deployment.
• Design isolation, failover, and recovery to make failures survivable.
• Automate capacity expansion, deployments, and maintenance.
• Develop observability and diagnostics to reveal bottlenecks and surface failures.
• Respond to incidents and perform root cause analysis.
• Improve performance, utilization, security, and reliability.

Required qualifications

• Experience building and operating production infrastructure or distributed systems with real ownership of reliability.
• Strong Linux fundamentals.
• Practical knowledge of networking, storage, and containers.
• Hands-on experience running Kubernetes in production.
• Ability to write maintainable software and automation to solve infrastructure problems.
• Systematic approach to debugging problems across application, cluster, network, and hardware boundaries.
• Good judgment about when to move quickly, when to simplify, and where reliability matters most.
• Initiative to take a problem from investigation through implementation.

Nice to have

• Experience with multi-region, multi-provider, or bare-metal infrastructure.
• Familiarity with GPUs, model serving, or inference systems such as vLLM or SGLang.
• Experience with infrastructure as code, CI/CD, observability, or automated recovery.
• Experience building highly available services, multi-tenant platforms, or distributed data systems.

About the company

Parasail delivers an enterprise-grade inference cloud for open-weight models. They pool GPU capacity from providers around the world to serve customers via an OpenAI-compatible API.