Model Operations Lead, AI Gateway

The role

You will lead the models team to manage model operations and model intelligence for AI Gateway. This includes handling provider integrations, capability testing, pricing, and building auto-routing profiles.

What you will do

• Build and lead the models team by hiring, coaching, and growing people.
• Run model launches end-to-end including integrations, testing, and pricing.
• Ensure the catalog reflects reality and identify underperforming models.
• Deliver auto-routing that beats fixed model choices on cost or quality.
• Build and maintain trusted rankings and recommendations.
• Set clear expectations for providers and align stakeholders.
• Provide clear ownership and direction to the team.
• Drive down human effort through tools and automation.

Required qualifications

• Experience hiring, managing, and growing engineers or operators.
• Track record of taking technical launches or integrations to production.
• Hands-on ability to write TypeScript, Python, or Rust.
• Ability to read API docs, inspect endpoints, and debug using terminal tools.
• Deep familiarity with new models, labs, and inference providers.
• Understanding of streaming, tool calling, structured outputs, rate limits, token pricing, and provider-specific model behavior variations.
• Data-driven product instincts.
• SRE approach to service health, managing incidents, and fixing root causes.
• Daily experience building with agents.

Nice to have

• Experience at an inference provider, model lab, model router, eval platform, or API company.
• Background in evals, ranking/recommendation systems, observability, metering, or usage-based billing.
• Familiarity with Cloudflare Workers, AI Gateway, Workers AI, or Replicate.
• Relevant domain backgrounds in engineering management, SRE, partner engineering, evals/applied ML, technical program management, or solutions engineering.

Benefits

• Medical/Rx Insurance
• Dental Insurance
• Vision Insurance
• Flexible Spending Accounts
• Commuter Spending Accounts
• Fertility & Family Forming Benefits
• On-demand mental health support and Employee Assistance Program
• Global Travel Medical Insurance
• Short and Long Term Disability Insurance
• Life & Accident Insurance
• 401(k) Retirement Savings Plan
• Employee Stock Participation Plan

Before you apply

• Applicants who progress to the offer stage may be asked to attend an in-person interview.
• Offer may be conditioned on authorization to receive software or technology controlled under U.S. export laws without sponsorship for an export license.

About the company

Cloudflare runs one of the world’s largest networks that powers millions of websites and Internet properties. The company aims to help build a better Internet.