Staff Engineer, AI

The role

You will lead the unified API team to ensure new models and providers work with LiteLLM on day one. You will own model and provider rollouts, design provider-agnostic features, and manage open source issues.

What you will do

• Lead the unified API team and own new model, endpoint, and provider rollouts end to end.
• Design provider-agnostic features at the gateway level.
• Triage open source issues and outside PRs.
• Review the AI team's PRs and hold a high bar for code quality.
• Find power users to decide what to build next.
• Take on new unification bets with customers.
• Own the developer experience for LiteLLM's Python SDK and proxy.

Required qualifications

• Machine learning engineer who builds applied AI products.
• 3+ years of experience.
• Deep expertise in LLM APIs.
• Experience building or maintaining a unified API that sits in front of many providers.
• Taste in developer experience.
• Customer empathy.
• Ready to lead a team from day one.
• Strong software engineering fundamentals in Python.

Nice to have

• Experience at a company built on a unified API, such as OpenRouter, Vercel AI SDK, Merge, Segment, or Fivetran.
• Built your own unified API or written about what a good one should do.
• Built evals for LLMs.
• Used LiteLLM in production.
• Open source contributions, especially to LLM tooling.

Benefits

• Competitive salary
• Equity
• Health benefits
• Dental benefits
• Vision benefits
• Relocation help

Before you apply

• Support H-1B transfers

About the company

LiteLLM is the world's most widely adopted AI Gateway, providing a unified API for 100+ LLM providers. Thousands of companies rely on LiteLLM to power AI in production.