Senior Product Manager, Inference

The role

This Senior Product Manager will own the product layer between inference infrastructure and developers or enterprises. You will shape inference product strategy and improve developer experience for APIs and SDKs.

What you will do

• Shape the inference product strategy.
• Own the developer experience around inference.
• Build for emerging workloads and modalities.
• Turn infrastructure and model capabilities into customer-facing products.
• Connect product decisions to business outcomes.
• Stay close to customers and the product.
• Drive products from idea to production.

Required qualifications

• Strong product judgment and the ability to take an ambiguous technical problem, identify what matters, make tradeoffs, and develop a clear point of view.
• Meaningful experience building or owning APIs, developer tools, infrastructure, cloud platforms, data systems, AI products, or another technically deep product.
• Strong technical depth and curiosity.
• A hands-on operating style.
• Strong developer and customer empathy.
• A track record of making clear product decisions and shipping in fast-moving environments.
• Strong communication and cross-functional leadership.

Nice to have

• Experience with LLM inference
• Experience with model serving
• Experience with distributed systems
• Experience with GPU infrastructure
• Experience with agents
• Experience with developer-facing AI products

Benefits

• startup equity
• health insurance
• other competitive benefits

Before you apply

• Candidates are limited to 6 applications within a 90-day period.

About the company

Together AI, the AI Native Cloud, is purpose-built for AI engineers. It provides high-performance inference, fine-tuning, reinforcement learning, and pre-training for leading open models.