Director of Product

The role

You will own the product strategy and evolution of the FriendliAI inference platform. You will define how the platform serves models, scales across workloads, and delivers performance, reliability, and cost gains.

What you will do

• Own the product vision, strategy, and roadmap for the AI inference platform.
• Define product direction across the inference stack.
• Identify and prioritize product opportunities across AI workloads.
• Translate technical capabilities into product value and customer experiences.
• Develop understanding of AI inference workloads and challenges.
• Partner with engineering and research to shape capabilities.
• Drive product strategy around critical inference metrics.
• Work with enterprise customers to validate product direction.
• Partner with Sales, Solutions, Customer Success, and Marketing.
• Lead and mentor Product Managers and Product Designers.

Required qualifications

• 10+ years of product management experience.
• Significant experience owning technically complex platforms or infrastructure products.
• Proven experience leading product strategy for AI/ML infrastructure, cloud platforms, distributed systems, developer platforms, or related technical products.
• Deep understanding of AI inference and LLM serving architectures.
• Strong technical fluency to work with senior engineering and research teams.
• Proven track record taking complex products from strategy through execution and adoption.
• Experience leading and developing Product Managers and/or coordinating multiple product workstreams.
• Strong customer orientation with experience working with enterprise customers and technical users.
• Strong written and verbal communication.
• Strong product judgment to operate in a fast-moving environment with ambiguity.

Nice to have

• Experience with AI inference platforms, LLM serving, GPU infrastructure, or model deployment.
• Familiarity with modern inference frameworks such as vLLM, TensorRT-LLM, SGLang, or similar technologies.
• Experience building developer platforms, APIs, SDKs, or cloud-native infrastructure products.
• Experience with multi-tenant SaaS or enterprise AI platforms.
• Experience working with ML engineers, AI platform teams, or infrastructure organizations.
• Background in Computer Science, Engineering, or a closely related technical field.

Benefits

• Flexible working hours
• Daily lunch and dinner provided
• Unlimited snacks and beverages
• Supportive and highly collaborative work environment
• Health check-up support
• Top-tier equipment/hardware support
• Competitive compensation
• Startup equity
• Health insurance

About the company

FriendliAI is the fastest inference cloud for agents, built to run frontier open-weight models in production at scale. It is a small, fast-moving team building a platform for demanding agent workloads.