Cognition
Research Engineer, Safety & Alignment
San Francisco. Posted a month ago
The role
You will be a founding member of the safety team building evaluations and red-teaming for Devin. You will develop alignment methods and work with the agent team on how the agent plans, acts, and asks for help.
What you will do
- Design and run evaluations for failure modes like unsafe actions, prompt injection, data exfiltration, sandbox escape, reward hacking, and misuse.
- Attack the agent and its harness systematically through red-teaming.
- Develop alignment methods including reward modeling, preference data, and constitutional approaches.
- Partner with the agent team on permissions, oversight, and escalation.
- Contribute to external safety work through papers, evals, and open methods.
Required qualifications
- Safety or alignment research experience in evaluations, red-teaming, alignment, or interpretability.
- Agentic systems understanding regarding tool misuse, specification gaming, long-horizon drift, and adversarial inputs.
- Proficiency in Python and PyTorch or JAX.
- Ability to build eval infrastructure and run experiments at scale.
- Empirical rigor in designing experiments and reporting results.
- Comfort with adversarial thinking.
- PhD in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline; or equivalent industry research experience.
Nice to have
- Prior experience at a frontier AI lab, applied AI company, or developer tools company.
About the company
Cognition is an applied AI lab building end-to-end software agents. They are the makers of Devin, the first AI software engineer.