Software Engineer, Developer Productivity - Inference Runtime

The role

You will support OpenAI's Inference Runtime teams by scaling engineering systems, safeguards, and developer workflows. You will work on tooling and operational foundations for model launches, inference optimizations, and large-scale deployments.

What you will do

• Improve systems that ensure inference engine releases are correct, performant, and regression-free
• Bring rigor to release, validation, branching, and deployment processes
• Improve canary, async, and large-scale validation workflows for inference systems
• Harden CI, testing, and validation infrastructure
• Reduce noisy or flaky failures caused by infrastructure instability, GPU scheduling, or test environment issues
• Build automation for failure triage, ownership detection, debugging, and escalation
• Partner with inference, research developer productivity, engine acceleration, and infrastructure teams
• Reduce developer friction in testing, debugging, and release workflows

Required qualifications

• Strong experience with CI/CD systems, testing infrastructure, release tooling, developer productivity, or large-scale build and validation systems
• Comfortable working in Python-heavy environments
• Comfortable debugging complex distributed systems
• Comfortable operating in ambiguous areas without a fully predefined roadmap

Nice to have

• C++ experience

Before you apply

• Background checks for applicants will be administered in accordance with applicable law

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.