Openai

Researcher, Frontier Cybersecurity Risks

San Francisco. Posted 3 months ago

The role

You will design and implement an end-to-end mitigation stack to reduce severe cyber misuse across OpenAI's products. This involves integrating safeguards, evaluating technical trade-offs, and executing red-teaming workflows.

What you will do

  • Design and implement mitigation components for model-enabled cybersecurity misuse
  • Integrate safeguards across product surfaces in partnership with product and engineering teams
  • Evaluate technical trade-offs within the cybersecurity risk domain
  • Collaborate with risk and threat modeling partners to align mitigation design with attacker behaviors
  • Execute rigorous testing and red-teaming workflows

Required qualifications

  • Demonstrated experience in deep learning and transformer models
  • Proficient with frameworks such as PyTorch or TensorFlow
  • Strong foundation in data structures, algorithms, and software engineering principles
  • Familiar with methods for training and fine-tuning large language models, including distillation, supervised fine-tuning, and policy optimization
  • Significant experience designing and deploying technical safeguards for abuse prevention, detection, and enforcement at scale

Nice to have

  • Background knowledge in cybersecurity or adjacent fields

Before you apply

  • Background checks for applicants will be administered in accordance with applicable law

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.

Researcher, Frontier Cybersecurity Risks at Openai | JobZoey