Openai
Researcher, Frontier Cybersecurity Risks
San Francisco. Posted 3 months ago
The role
You will design and implement an end-to-end mitigation stack to reduce severe cyber misuse across OpenAI's products. This involves integrating safeguards, evaluating technical trade-offs, and executing red-teaming workflows.
What you will do
- Design and implement mitigation components for model-enabled cybersecurity misuse
- Integrate safeguards across product surfaces in partnership with product and engineering teams
- Evaluate technical trade-offs within the cybersecurity risk domain
- Collaborate with risk and threat modeling partners to align mitigation design with attacker behaviors
- Execute rigorous testing and red-teaming workflows
Required qualifications
- Demonstrated experience in deep learning and transformer models
- Proficient with frameworks such as PyTorch or TensorFlow
- Strong foundation in data structures, algorithms, and software engineering principles
- Familiar with methods for training and fine-tuning large language models, including distillation, supervised fine-tuning, and policy optimization
- Significant experience designing and deploying technical safeguards for abuse prevention, detection, and enforcement at scale
Nice to have
- Background knowledge in cybersecurity or adjacent fields
Before you apply
- Background checks for applicants will be administered in accordance with applicable law
About the company
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.