Software Engineer, ChatGPT Infrastructure

The role

Senior and Staff Engineers will design and build infrastructure systems that underlie ChatGPT. You will develop core abstractions, interfaces, and tooling to enable fast, safe iteration and improve system performance and reliability.

What you will do

• Build and evolve infrastructure platforms used by many engineers and services.
• Translate real-world constraints into clean abstractions like simple APIs and safe defaults.
• Drive improvements in reliability and performance through design and measurement.
• Partner with engineering and product teams to develop reusable solutions.
• Own outcomes from design and implementation to rollout and operational maturity.

Required qualifications

• Experience building and operating large-scale distributed systems in production.
• Strong fundamentals in systems design including caching, consistency, queueing/backpressure, and resilient dependency management.
• Ability to reason about performance such as latency distributions, tail behavior, and bottlenecks.
• Track record of building platforms or shared infrastructure that improves velocity and correctness for other teams.
• Excellent communication and collaboration skills.

Nice to have

• Experience designing paved roads / golden paths that shape engineering behavior at scale.
• Deep understanding of reliability techniques: graceful degradation, circuit breakers, load shedding, rate limiting, and fault isolation.
• Experience building systems for safe iteration: progressive delivery, correctness checks, automated rollout gates, and production validation.
• Strong instincts for API and contract design.
• Prior work that demonstrates force multiplier impact.

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. They seek to safely deploy AI to the world through their products.