Openai

Researcher, Frontier Risk Mitigations

San Francisco. Posted 3 months ago

The role

You will develop novel safety mitigations and apply techniques from domains like interpretability, control, and alignment to derisk frontier models. You will work on identifying emerging AI safety risks and building evaluations to assess them.

What you will do

  • Work on identifying emerging AI safety risks and new methodologies for exploring and mitigating the impact of such risks
  • Build and continuously refine evaluations to assess the extent of risks
  • Set research directions and strategies to make AI systems safer, more aligned, and more robust
  • Contribute to the development of best practices guidelines for AI safety
  • Evaluate and design effective red-teaming pipelines to examine the end-to-end robustness of safety systems

Required qualifications

  • 2+ years of experience in the field of AI safety, especially in areas like RLHF, human-AI collaboration, interpretability, or control
  • Ph.D. or other degree in computer science, machine learning, or a related field
  • 4+ years of research engineering experience
  • Proficiency in Python or similar languages

Nice to have

  • Excited about OpenAI’s mission of building safe, universally beneficial AGI
  • Enthusiasm for long-term AI safety
  • Thrive in environments involving large-scale AI systems

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. They push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through their products.

Researcher, Frontier Risk Mitigations at Openai | JobZoey