Baseten

Capacity Manager, Operations

San Francisco, Remote. Posted 2 months ago

The role

This person will own the operational and analytical supply side of the GPU fleet. They will manage GPU fleet lifecycle, health, observability, utilization monitoring, and remediation across neocloud and bare metal environments.

What you will do

  • Drive suppliers to keep the maximum amount of the GPU fleet online and healthy.
  • Maintain a live reconciliation of contracted vs. provisioned vs. healthy vs. utilized capacity.
  • Own replacement SLAs, mean time to repair (MTTR), and RMA cycle times for every in-scope supplier.
  • Track SLA performance against contract terms.
  • File and pursue credit claims.
  • Drive remediation plans when suppliers fall short.
  • Drive internal communications regarding supplier maintenance to ensure stakeholders are aware of activities impacting availability.

Required qualifications

  • 5 to 10+ years within infrastructure working within the compute lifecycle to maximize functional compute, ideally in a hyperscale, cloud, or large-scale compute environment.
  • Direct experience managing GPU, server, or data center hardware supplier relationships.
  • Understanding of fleet health, RMA processes, and how contracted capacity differs from delivered capacity.
  • Highly analytical.
  • Comfortable pulling own data, building own reports, and generating insights.
  • Comfortable with ambiguity.
  • Strong cross-functional collaboration skills.

Nice to have

  • Experience at a hyperscaler, neo cloud provider, or AI infrastructure company
  • Familiarity with GPU hardware lifecycles (NVIDIA H100/H200/GB200 class systems), power/thermal constraints, and supply chain dynamics for compute.
  • Experience running formal supplier corrective actions.

Benefits

  • Competitive compensation, including meaningful equity
  • 100% coverage of medical, dental, and vision insurance for employee and dependents (U.S. only)
  • Flexible PTO policy including company wide Winter Break
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • Company-facilitated 401(k) (U.S. only)
  • Exposure to a variety of ML startups

About the company

Baseten powers mission-critical inference for the world's most dynamic AI companies. They enable companies operating at the frontier of AI to bring cutting-edge models into production.

Capacity Manager, Operations at Baseten | JobZoey