Software Engineer, Search Infrastructure

The role

You will design, build, and operate systems that connect models with search at ChatGPT scale. You will work on search orchestration, inference efficiency, experimentation, and production reliability.

What you will do

• Design and evolve services that coordinate search classification, retrieval, ranking, and model inference.
• Improve end-to-end latency, throughput, and infrastructure efficiency.
• Build experimentation tooling and automation to run reproducible A/B tests.
• Use shadow traffic and load testing to validate system behavior and estimate capacity needs.
• Own production reliability through observability, resilient fallback behavior, and incident response.
• Build search APIs and tool interfaces that enable models and agents to retrieve information.

Required qualifications

• Significant experience designing, building, and operating large-scale distributed systems.
• Depth in performance, reliability, or resource efficiency.
• Experience in one or more of search, information retrieval, ML infrastructure, inference serving, or other high-throughput online systems.
• Strong programming and systems debugging skills.
• Comfortable working across languages and unfamiliar parts of a production stack.
• Ability to turn ambiguous product or research needs into clear technical plans.
• Ability to align partners across teams and carry projects through deployment.

Benefits

• Relocation assistance

Before you apply

• Background checks for applicants will be administered in accordance with applicable law.

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.