AI Red Teamer, CBRNE (Remote)

The role

You will evaluate whether AI models appropriately handle queries related to chemical, biological, radiological, nuclear, and explosive threats. You will design adversarial prompts and test model defenses to find and document knowledge gaps in safety guardrails.

What you will do

• Design technically grounded adversarial prompts that test whether models provide meaningful uplift toward CBRNE threats
• Evaluate model outputs for technical accuracy
• Probe dual-use knowledge boundaries
• Test multi-step and multi-turn attack chains
• Score model responses against structured harm taxonomies and severity rubrics
• Document findings with clear technical reasoning
• Identify the difference between open literature and genuine uplift
• Contribute to the development and refinement of CBRNE-specific evaluation frameworks and threat models
• Collaborate with other red teamers, AI researchers, and policy teams
• Stay current on evolving model capabilities and jailbreak techniques

Required qualifications

• Graduate-level education or equivalent professional experience in a relevant CBRNE field (chemistry, biochemistry, microbiology, virology, nuclear physics, radiochemistry, materials science, munitions
• Ability to evaluate the technical accuracy and real-world consequence of model outputs in your domain
• Understanding of dual-use research concerns and the distinction between open-source knowledge and operationally significant uplift
• Strong hands-on experience using multiple LLMs (ChatGPT, Claude, Gemini, open-source models, etc.)
• Creative, adversarial problem-solving skills
• Clear and precise written communication
• Strong ethical judgment
• Self-directed, collaborative, and comfortable in feedback-heavy environments

Nice to have

• Active or prior security clearance (Secret, Top Secret, or SCI)
• Experience in threat assessment, WMD analysis, intelligence analysis, or arms control verification
• Background in biosafety/biosecurity, chemical safety, nuclear nonproliferation, or explosive ordnance disposal
• Familiarity with relevant regulatory frameworks (CWC, BWC, IAEA safeguards, ATF regulations, Export Administration Regulations)
• Experience in red teaming, penetration testing, or structured adversarial evaluation in any context
• Familiarity with Python or scripting languages, LLM APIs, or evaluation tooling
• Published research or professional presentations in a relevant CBRNE domain
• Prior work in trust and safety, content moderation, or AI evaluation

Before you apply

• We are not currently hiring candidates based in California for this role

About the company

Handshake powers 25 million job seekers, 1 million+ employers, and 1,600 educational institutions. Handshake AI works directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data.