Openai
Researcher, Frontier Risk Mitigations
San Francisco. Posted 3 months ago
The role
You will develop novel safety mitigations and apply techniques from domains like interpretability, control, and alignment to derisk frontier models. You will work on identifying emerging AI safety risks and building evaluations to assess them.
What you will do
- Work on identifying emerging AI safety risks and new methodologies for exploring and mitigating the impact of such risks
- Build and continuously refine evaluations to assess the extent of risks
- Set research directions and strategies to make AI systems safer, more aligned, and more robust
- Contribute to the development of best practices guidelines for AI safety
- Evaluate and design effective red-teaming pipelines to examine the end-to-end robustness of safety systems
Required qualifications
- 2+ years of experience in the field of AI safety, especially in areas like RLHF, human-AI collaboration, interpretability, or control
- Ph.D. or other degree in computer science, machine learning, or a related field
- 4+ years of research engineering experience
- Proficiency in Python or similar languages
Nice to have
- Excited about OpenAI’s mission of building safe, universally beneficial AGI
- Enthusiasm for long-term AI safety
- Thrive in environments involving large-scale AI systems
About the company
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. They push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through their products.