Member of Technical Staff (TPM, Inference)

The role

This person will drive the core inference platform roadmap and act as connective tissue between model providers, engineering, and product teams. They will manage model onboarding, capacity, and execution metrics like latency, throughput, and cost-efficiency.

What you will do

• Execute the roadmap for the inference platform request handling, rate limits, quotas, usage controls, and reliability and observability.
• Coordinate onboarding, launch readiness, and rollout for new models and capacity between model providers and internal teams.
• Drive latency, throughput, uptime, and cost-efficiency as core execution metrics.
• Run the operating model for model-release and optimization programs.
• Lead cross-functional delivery for inference-stack changes from planning through post-launch validation.
• Build mechanisms like dashboards and launch checklists to make releases predictable.
• Partner with GPU capacity and compute teams to reconcile decisions against cost, capacity, and vendor constraints.

Required qualifications

• Strong experience with technical program management or product management in infrastructure, distributed systems, or ML/model-serving products.
• Direct experience with production LLM or ML inference.
• Comfort orchestrating across external partners and internal engineering teams with competing priorities and timelines.
• Experience with data and metrics and the judgment to surface tradeoffs between latency, throughput, uptime, and cost.
• Thrives in a small, agile team.
• Has initiative and desire for ownership without much precedent to lean on.
• 6+ years of combined technical program management or product management experience.

About the company

Perplexity's mission is to power curiosity. Perplexity runs one of the highest-throughput inference stacks in the industry, serving Ask, Computer, and API traffic.