Litellm

Senior Security Engineer, Product & Platform

San Francisco. Posted 9 days ago

The role

This individual contributor will secure the application, infrastructure, and software delivery pipeline. You will review and harden the Python codebase and implement security improvements.

What you will do

  • Review and harden LiteLLM's Python codebase
  • Review sensitive pull requests and architecture changes
  • Harden build and release pipeline
  • Build and maintain automated controls for secrets detection and credential management
  • Review cloud architecture, IAM, secrets management, and workload identity
  • Build guardrails and secure defaults
  • Document security architecture, decisions, and operating practices
  • Own delivery and maintenance of product and pipeline security improvements

Required qualifications

  • 7+ years of relevant experience, including independent ownership of a security scope
  • Experience hardening a production CI/CD pipeline, including GitHub Actions permissions and keyless signing
  • Strong knowledge of a major cloud provider
  • Ability to read production Python web-service code, identify vulnerabilities, and implement fixes
  • Experience building security tooling and guardrails that engineering teams adopted
  • Strong judgment about prioritization and risk
  • Excellent written and verbal communication

Nice to have

  • Knowledge of AWS
  • Familiarity with Terraform
  • Experience as the first or second security hire at a developer-tools or open-source company
  • A background in software, platform, or infrastructure engineering
  • Experience leading platform or infrastructure security, defining roadmaps, and owning the security of releases

About the company

LiteLLM provides a unified API for LLM providers, along with routing, authentication, budgets, observability, and governance for production AI systems.

Senior Security Engineer, Product & Platform at Litellm | JobZoey