Togetherai

Product Manager, AI Infrastructure

San Francisco. Posted 4 months ago

The role

You will own day-to-day product and feature work for AI infrastructure products including GPU clusters, managed storage, and observability. You will partner with engineering to ship features and use data and experimentation to drive product decisions.

What you will do

  • Own day-to-day product and feature work across GPU Clusters, Managed Storage, and observability
  • Find and drive problems to resolution with minimal guidance
  • Run structured, hypothesis-driven experiments
  • Partner across engineering, product, and partner teams to ship improvements
  • Translate customer understanding into product decisions
  • Juggle multiple priorities and workstreams across a broad infrastructure surface
  • Grow into end-to-end ownership of a complete product area

Required qualifications

  • Deep empathy for customers operating in high-ambiguity, fast-evolving markets
  • Strong, hands-on data and analytics skills with a hypothesis-driven approach
  • High agency
  • A real technical foundation from an AI/infrastructure background, hands-on software development, or strong working knowledge of cloud and infrastructure
  • A track record of collaborating across orgs and product lines
  • Comfortable managing multiple priorities and workstreams at once

Nice to have

  • Familiarity with the AI stack, especially at the infrastructure layer
  • Cloud platform experience (AWS, Azure, GCP, or similar)
  • Working knowledge of the Nvidia/AMD GPU stack (InfiniBand, NCCL, GPU operator, etc.)
  • Experience with AI training or inference workloads

Benefits

  • startup equity
  • health insurance
  • other competitive benefits

Before you apply

  • Candidates are limited to 6 applications within a 90-day period

About the company

Together AI is the AI Native Cloud purpose-built for AI engineers. It provides high-performance inference, fine-tuning, reinforcement learning, and pre-training.

Product Manager, AI Infrastructure at Togetherai | JobZoey