Staff Engineer, Systems and Reliability

The role

A hands-on Staff Engineer will own the stability and reliability of the LiteLLM gateway. You will find root causes of regressions and security issues to refactor or rewrite them.

What you will do

• Find the root causes of regressions and security issues and fix the patterns that create them.
• Lead refactors, rewrites, and migrations of core product code.
• Decide what makes the test suite worth trusting and build it.
• Keep CI and releases fast and trustworthy with a large open source contributor base.
• Review the code paths that matter most and raise the bar through code and review.
• Raise quality across the team without becoming the bottleneck.

Required qualifications

• 3+ years of experience, with a fast rise in scope at a strong engineering company.
• Owned stability or reliability at your current company.
• Owned mission-critical systems in production and led rewrites or code migrations.
• Able to walk into an unfamiliar codebase and find the real root cause.
• A first principles thinker.
• Customer empathy.
• Strong software engineering fundamentals.

Nice to have

• Python
• Rust experience.
• Kept CI healthy on an open source project with heavy outside contribution.
• Experience at an early-stage startup.

Benefits

• Competitive salary
• Equity
• Health benefits
• Dental benefits
• Vision benefits
• Help with relocation
• Support H-1B transfers

About the company

LiteLLM is the world's most widely adopted AI Gateway. It provides a unified API for 100+ LLM providers for production AI systems.