Staff Product Manager, AI Inference

The role

You will lead strategic efforts in shaping and developing AI inference services. You will collaborate with engineers, designers, and partners to create products for building, deploying, scaling, and optimizing AI models.

What you will do

• Refine product strategy for AI application cloud services and optimization for AI workloads.
• Own the product roadmap for AI inference services.
• Stay current on advancements in AI/ML technologies.
• Define new product investments and a portfolio of inference capabilities.
• Collaborate with customers to understand AI workloads and requirements.
• Collaborate with engineering, sales, marketing, and customer success teams.
• Analyze market trends, customer feedback, and the competitive landscape.
• Partner with industry partners, marketing, and sales to execute go-to-market strategies.

Required qualifications

• 8+ years of experience in product management.
• At least 5 years in the cloud services or AI/ML market segment.
• Hands on practitioner and deep understanding of AI/ML workloads including foundation model inference.
• Knowledge of inference engines such as vllm, SGLang, TensorRT-llm, and llm-d.
• Knowledge of inference optimization techniques such as quantization and speculative decoding.
• Knowledge of cloud infrastructure (GPUs).
• Knowledge of cloud-native architectures (Kubernetes, microservices).
• Proven ability to lead cross functional teams.
• Strong decision-making, project management, and mentoring skills.
• Demonstrated experience working closely with customers.
• Excellent verbal and written communication skills.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.

Nice to have

• MBA or equivalent experience

Benefits

• Medical, dental, and vision insurance - 100% paid by CoreWeave
• Company-paid Life Insurance
• Voluntary supplemental life insurance
• Short and long-term disability insurance
• Flexible Spending Account
• Health Savings Account
• Tuition Reimbursement
• Ability to Participate in Employee Stock Purchase Program (ESPP)
• Mental Wellness Benefits through Spring Health
• Family-Forming support provided by Carrot
• Paid Parental Leave
• Flexible, full-service childcare support with Kinside

Before you apply

• Must be a U.S. person (citizen, national, lawful permanent resident, refugee, or asylee) or eligible to access export controlled information.

About the company

CoreWeave is a cloud provider for AI that delivers a platform of technology, tools, and teams. Founded in 2017, it became a publicly traded company in March 2025.