Member of Technical Staff, Cloud Orchestration

The role

You will build the operational backbone to keep vLLM running at scale. You will design systems for cluster management, deployment automation, and production monitoring.

What you will do

• Design systems for cluster management, deployment automation, and production monitoring
• Ensure vLLM deployments are observable, debuggable, and recoverable

Required qualifications

• Bachelor's degree or equivalent experience in computer science, engineering, or similar
• Strong experience with Kubernetes and container orchestration at scale
• Experience designing and implementing custom Kubernetes operators
• Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc)
• Experience managing GPU clusters and debugging hardware issues
• Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure

Nice to have

• Experience with ML-specific orchestration tools (Ray, Slurm)
• Knowledge of GPU scheduling, multi-tenancy, and resource optimization
• Familiarity with vLLM deployment patterns and configuration
• Track record of improving operational reliability for ML systems
• Experience deploying inference systems on large-scale GPU (1,000+) clusters

Benefits

• health, dental, and vision benefits
• 401(k) company match

Before you apply

• We sponsor visas on a case-by-case basis

About the company

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress. Founded by the creators and core maintainers of vLLM, the company sits at the intersection of models and hardware.