Model Policy Manager, Agentic Safety

The role

You will investigate how misaligned behavior emerges in autonomous models and translate these insights into behavioral policies, evaluations, and safeguards. You will work with research, engineering, security, and product teams to address real-world risks from model misalignment.

What you will do

• Identify vulnerabilities from model interactions and translate them into safeguards
• Develop threat models and empirical frameworks for understanding harmful outcomes
• Build frameworks for understanding harmful outcomes from model misalignment
• Identify underlying behaviors and system conditions driving outcomes
• Turn findings into policy frameworks, evaluation criteria, and safeguards
• Develop human data campaigns and gold sets for measurement and evaluation
• Partner with research, engineering, security, and product teams
• Inform deployment decisions, system cards, and safeguards reports
• Build monitoring approaches to detect regressions and emerging risks

Required qualifications

• Strong background in AI agent safety, privacy, security, cybersecurity, or adjacent fields
• Adversarial mindset to investigate real-world harmful outcomes
• Demonstrated interest in AI alignment
• Strong understanding of the technical drivers of misaligned model behavior
• Technical fluency to work with evaluation and training data
• Ability to inspect examples, analyze failure patterns, and assess data quality
• Ability to use empirical evidence to develop and refine safety policies and safeguards
• Ability to translate complex or ambiguous alignment risks into precise behavioral expectations
• Ability to work effectively across research, engineering, security, product, and policy
• Ability to communicate clearly about complex and uncertain technical risks
• Ability to work in fast-paced, collaborative research environments

Benefits

• Relocation support

Before you apply

• Background checks for applicants will be administered in accordance with applicable law

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.