Data Scientist, Core Experimentation

The role

You will lead the evolution of the core experimentation platform by driving statistical direction and technical strategy. You will design methodologies, build analytical systems in Python, and partner with engineering and product teams to improve decision-making.

What you will do

• Drive the statistical direction and technical strategy for OpenAI’s experimentation platform
• Design and improve experimentation methodologies used across product and research teams
• Build pragmatic solutions to real-world experimentation challenges
• Improve the reliability and trustworthiness of experiment results
• Develop scalable analytical systems and pipelines in Python and distributed compute environments
• Partner with engineers and product teams to improve experiment design and metric quality
• Lead investigations into complex experimentation anomalies and measurement failures
• Establish best practices for experimentation governance, interpretation, and statistical correctness
• Mentor other data scientists

Required qualifications

• Experience building, scaling, or operating experimentation platforms at a large technology company
• Deep expertise in statistics, causal inference, and online experimentation methodology
• Strong understanding of practical experimentation challenges in production systems
• Experience with areas such as variance reduction, CUPED, sequential testing, SRM detection, metric design, or heterogeneous effects
• Strong coding and systems skills in Python and large-scale data processing frameworks (e.g. Spark)
• Experience designing analytical data models and scalable experimentation pipelines
• Ability to communicate complex statistical concepts clearly to technical and non-technical audiences
• Track record of influencing technical strategy through hands-on technical leadership

Nice to have

• Experience in large-scale product experimentation, ML experimentation, ranking systems, marketplace systems, or similar high-scale experimentation domains is highly valued

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. They seek to safely deploy AI to the world through their products.