Safeguards Enforcement Lead, User Well-Being

The role

You will manage enforcement workflows for child safety, mental health, abuse, exploitation, and age assurance. You will lead a team of individual contributors and serve as the central contact for content review partners.

What you will do

• Manage a team of individual contributors across multiple policy areas
• Serve as the primary point of contact for review partners
• Design and improve enforcement workflows
• Partner with Engineering and Data Science teams to optimize detection models
• Develop and maintain internal documentation, decision trees, and review guidelines
• Keep up to date with emerging AI policy enforcement best practices and legal frameworks
• Identify and report trends in misuse patterns to internal stakeholders
• Coordinate reporting obligations to relevant external bodies

Required qualifications

• Experience managing teams in the User Well-Being space
• Experience in trust & safety, content moderation operations, or policy enforcement with direct exposure to child safety, mental health, abuse and exploitation, and age assurance harm areas
• Experience managing or coordinating content review operations, including quality assurance and workflow management
• Experience standing up and scaling policy enforcement or content review workflows
• Proficiency in SQL and/or other data analysis tools
• Experience identifying emerging risks and communicating findings to cross-functional stakeholders
• Understanding of the challenges involved in implementing product policies at scale in the content moderation space
• Bachelor’s degree or an equivalent combination of education, training, and/or experience
• A field relevant to the role as demonstrated through coursework, training, or professional experience

Nice to have

• Deep subject matter expertise in child safety, child sexual exploitation and abuse (CSEA), online child protection, mental wellness, and age assurance
• Experience working with or reporting to NCMEC, IWF, or equivalent child safety reporting bodies
• Familiarity with relevant legal and regulatory frameworks, including CSAM reporting obligations, KOSA, COPPA, or equivalent international frameworks
• Experience working with generative AI products
• Experience designing or evaluating trauma-informed support structures and wellness protocols for content reviewers
• Proficiency in Python for workflow automation or data analysis
• Experience working with hash-matching technologies or perceptual hashing tools
• Familiarity with age assurance technologies

Benefits

• Competitive compensation
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Office space

Before you apply

• In this position you will regularly be exposed to and engage with explicit content of a sexual nature involving minors, as well as content that may be violent or psychologically disturbing
• We do sponsor visas

About the company

Anthropic is a public benefit corporation headquartered in San Francisco. Its mission is to create reliable, interpretable, and steerable AI systems.