Decagon
Senior Research Engineer, Safety
San Francisco. Posted 2 months ago
The role
You will make AI agents safe, reliable, and controllable from evaluation through production. You will build safeguards, adversarial evaluations, and classifiers to prevent failure modes.
What you will do
- Research and build safeguards against prompt injection, unsafe tool use, sensitive-data disclosure, policy violations, and hallucinated commitments
- Build adversarial evaluations, simulations, red-team datasets, and regression suites informed by production failures
- Develop and deploy classifiers, judges, reward signals, post-training methods, and runtime safeguards for safer agent behavior
- Analyze production traces and incidents to identify root causes, test mitigations, and measure their impact
- Partner with Security, Product, Infrastructure, Legal, and customer-facing teams to turn enterprise requirements into scalable safeguards and rollout practices
Required qualifications
- 4+ years of experience in AI/ML engineering, research, or AI safety
- Hands-on experience evaluating, post-training, or deploying language models or agentic systems
- Experience with modern post-training techniques, such as reinforcement learning, preference optimization, distillation, model routing, and synthetic-data generation
- Experience with adversarial testing, model red teaming, prompt injection, policy enforcement, privacy, or safe tool use
- Fluency in Python and modern ML tooling
- Strong experimental judgment and the engineering depth to ship production systems
- Comfort owning ambiguous, high-stakes technical problems and making clear risk and product tradeoffs
Nice to have
- Experience building safeguards for high-stakes or regulated enterprise workflows
- Familiarity with human-in-the-loop review, incident response, or responsible rollout frameworks for ML systems
Benefits
- Medical, Dental, and Vision benefits for you and your family
- Life Insurance and Disability Benefits
- Retirement Plan (e.g., 401K, pension)
- Parental Leave
- Fertility and family building benefits through Carrot
- Monthly stipend to support your wellness, lifestyle, and work-life balance
- Daily lunches and snacks in the office
- Take what you need vacation policy
About the company
Decagon is a conversational AI platform that enables enterprises to deploy AI agents across various channels. The company is an in-office company driven by values like Just Get It Done and The Polymath Principle.