Engineering Manager

The role

You will lead a team of engineers across areas such as inference systems, performance, kernels, accelerators, and cloud infrastructure. You will own team execution, hiring, coaching, prioritization, and operating rhythm.

What you will do

• Lead a team of engineers across inference systems, performance, kernels, accelerators, and cloud infrastructure
• Own team execution, hiring, coaching, prioritization, and operating rhythm
• Partner with engineering and company leadership to turn priorities into technical direction
• Remove blockers and improve how the team works
• Help engineers do high-leverage work
• Translate ambiguous company priorities into clear team goals and execution plans
• Build engineering operating rhythms around planning, decision-making, and technical reviews

Required qualifications

• Bachelor's degree or equivalent experience in computer science, engineering, or similar
• Demonstrated experience managing strong software engineers in technically demanding systems, infrastructure, ML systems, distributed systems, or performance-oriented environments
• Strong technical credibility to understand architecture and unblock senior engineers
• Experience owning the full people-management lifecycle including hiring, onboarding, 1:1s, feedback, performance management, career development, team health, and retention
• Ability to translate ambiguous company priorities into clear team goals, sequencing, ownership, and execution plans
• Track record of building effective engineering operating rhythms
• Strong judgment about when to dive into a technical problem and when to delegate
• 2+ years of management experience with 10+ reports

Nice to have

• Experience leading teams working on AI / ML infrastructure, model serving, distributed systems, GPU infrastructure, compilers, performance engineering, cloud infrastructure, or developer platforms
• Experience managing senior, staff, principal, research-adjacent, or PhD engineers
• Experience scaling an engineering team through rapid hiring
• Familiarity with inference systems and adjacent technologies such as vLLM, SGLang, PyTorch, CUDA / Triton, Kubernetes, distributed serving, or accelerator infrastructure
• Experience partnering closely with founders or engineering executives in an early-stage company
• Built or scaled a small, unusually high-talent engineering team
• Previously remained hands-on as an engineer or technical lead before moving into management
• Managed teams spanning multiple technical specialties, geographies, or time zones
• Helped establish engineering management practices from an early stage
• Contributed to open-source infrastructure, AI systems, developer tools, or technically ambitious products

Benefits

• Health benefits
• Dental benefits
• Vision benefits
• 401(k) company match

Before you apply

• We sponsor visas on a case-by-case basis

About the company

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress. Founded by the creators and core maintainers of vLLM, the company sits at the intersection of models and hardware.