AI Engineer

The role

The AI Engineer will ensure LiteLLM unifies the format for calling LLM APIs. This involves writing transformations for API requests and building provider-agnostic unification functionality.

What you will do

• Ensure LiteLLM unifies the format for calling LLM APIs in the OpenAI + Anthropic spec
• Write transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats
• Build provider-agnostic unification functionality
• Perform system design for supporting provider level features at the gateway level
• Support developer experience for users leveraging the LiteLLM Python SDK
• Maintain an LLM interoperability layer across LLM's, MCP's, and Agents
• Support a wide range of MCP Auth flows and enable various Agent use-cases

Required qualifications

• 1-2 years of backend/full-stack experience with production systems
• Passion for open source and user engagement
• Experience working with the OpenAI api
• Strong work ethic and ability to thrive in small teams
• Eagerness to talk to users and help solve real problems
• Python
• LLM APIs
• FastAPI

Benefits

• Work directly with the founders every day
• Build products used by thousands of engineering teams around the world
• Own meaningful product decisions
• Move incredibly fast and see your work in production immediately
• Help define the future of AI infrastructure and developer tooling
• Equity
• Health benefits
• Dental benefits
• Vision benefits

About the company

LiteLLM is the world's most widely adopted AI Gateway. They provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems.