Trust & Safety Lead, Education

The role

You will own safety on Playlab's platform, with a focus on children and young adults. You will make decisions on live incidents, moderation escalations and safety policy, and design systems that catch problems automatically. You will also write the safety playbooks for responsible AI in education.

What you will do

• Review flagged content, hunt for misuse, and stress-test features before and after they ship
• Define a Playlab-specific harm taxonomy and labeling guidelines
• Turn review and red-team findings into labeled sets engineering can use
• Write requirements for filters, rules and signals, and track how well detection works
• Lead incident response: triage, investigation, action, school communication, required reporting and post-incident review
• Work with Support on intake and escalation paths for urgent issues
• Write and maintain safety and moderation policies, including what schools can adjust
• Act as safety reviewer for new features at launch
• Serve as the safety contact for school and district leaders
• Report incident volume, response times, policy coverage and trends to leadership

Required qualifications

• 5+ years in trust & safety, including real-time decision-making on high-stakes escalations
• Experience handling safety work involving young people, such as self-harm or abuse disclosures, inappropriate contact or CSAM reporting
• Experience helping design automatic detection: labeling guidelines, filter requirements and checking whether they work
• Ability to work well with engineers without being one
• Ability to write principled, practical policies that frontline teams can apply consistently
• Ability to communicate clearly with school leaders, engineers and learning partners on the same day, asynchronously and remotely
• Care for student wellbeing, equity and access

Nice to have

• Hands-on experience finding where generative AI tools fail
• Experience with AI red teaming, evaluations or adversarial testing
• Experience with proactive investigations or abuse hunting
• Experience on platforms with user-generated content or creator tools
• Familiarity with FERPA, COPPA, state student data privacy laws and mandated reporting
• Classroom, school leadership, counseling or edtech experience
• Experience building trust & safety operations from scratch at a startup or nonprofit

Benefits

• Competitive salary
• Healthcare covered 100% for you and 80% for dependents
• Dental and vision covered 100% for you and dependents
• Retirement plan
• Life and AD&D insurance
• Monthly wellness stipend
• Home office budget
• New laptop
• Generous time off
• Opportunities for professional growth

Before you apply

• The work can involve disturbing material, including content involving harm to children, and the role includes setting handling procedures and support for staff

About the company

Playlab is a tech non-profit that helps educators and students become critical consumers and creators of AI. Over 100,000 educators have published apps on its platform.