Inference Engineering and Product Lead

The role

You will lead a group of engineers working on the LLM inference platform. This hands-on leadership role involves technical contribution, product shaping, and people management.

What you will do

• Recruit, hire, and grow a high-performing team of engineers
• Run regular 1:1s focused on coaching, feedback, and career growth
• Set clear performance expectations and build an engineering environment
• Drive technical and product decisions through design reviews, code reviews, and architectural discussions
• Lead efforts working with customers with novel or frontier workloads
• Translate customer learnings into a roadmap for the internal optimization platform and user-facing product
• Establish standards for reliability and product excellence
• Partner with business operations and compute strategy on compute purchase strategy
• Collaborate with GTM on product launches, positioning, and improving win rates
• Help guide the roadmap for infrastructure and adjacent product teams

Required qualifications

• 10+ years of industry experience
• 3+ years in a leadership role
• Track record of building high-performance systems at scale
• Strong background in cloud infrastructure
• Deep knowledge of low-level OS foundations (Linux kernel, file systems, containers, etc.)

Nice to have

• Experience working with LLM inference in production
• Familiarity with underlying concepts like engines, kernels, routing, KV cache management, and speculative decoding

About the company

Modal is building a new infrastructure layer for AI. Their customers include companies like Ramp, Cognition, DoorDash, and Suno.