Software Engineer, Caching Infrastructure

The role

You will design, build, and operate a multi-tenant caching platform used across inference, identity, quota, and product experiences. You will define the long-term vision and roadmap for caching as a core infrastructure capability.

What you will do

• Design, build, and operate OpenAI’s multi-tenant caching platform used across inference, identity, quota, and product experiences.
• Define the long-term vision and roadmap for caching as a core infra capability, balancing performance, durability, and cost.
• Collaborate with other infra teams and product teams to ensure our caching platform meets their needs.

Required qualifications

• 5+ years of experience building and scaling distributed systems, with a strong focus on caching, load balancing, or storage systems.
• Deep expertise with Redis, Memcached, or similar solutions, including clustering, durability configurations, client-side connection patterns, and performance tuning.
• Production experience with Kubernetes, service meshes (e.g., Envoy), and autoscaling systems.

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. They deploy models through ChatGPT, APIs, and other products.