Head of Trust & Safety

The role

The Head of Trust & Safety will own AI output safety, trust posture with districts, and student-facing safety. This person will lead a small team dedicated to student safety and partner with Legal on regulations.

What you will do

• Own the safety of AI output to teachers and students through policy, guardrails, evals, red-teaming, and incident response.
• Own the trust posture with districts including safety documentation and RFP responses.
• Develop safety evaluations and monitoring as product infrastructure.
• Own student-facing safety including age-appropriate content and crisis handling.
• Run the safety incident process end to end and own the postmortem loop.
• Partner with Legal on COPPA, FERPA, state privacy laws, and emerging AI regulation.
• Lead a small team dedicated to student safety.

Required qualifications

• Has owned trust & safety or responsible AI for a consumer or youth-facing product at scale.
• Hands-on with LLM safety: evals, classifiers, prompt/system-level guardrails, red-teaming.
• Makes judgment calls under ambiguity and owns them publicly.
• Strong writer for safety docs, district-facing explainers, and incident communications.
• Operates hypothesis-first and escalates one-way doors fast.
• Experience handling live incidents involving minors or vulnerable users.
• Track record of building safety as product infrastructure.
• Demonstrated ability to communicate safety tradeoffs clearly to executive and district-level audiences.

Nice to have

• K-12 or youth-platform experience (GoGuardian, Securly, Roblox, Discord, YouTube Kids, Epic Games).
• Familiarity with state AI-in-education frameworks and district procurement questionnaires.
• Prior work with child-safety NGOs or standards bodies (Common Sense Media, NCMEC, Thorn, ISTE).
• Data/ML fluency to partner directly with engineering on classifiers and eval pipelines.
• Comfortable being the external face of safety at conferences, with press, and in front of district boards.

Benefits

• Flexibility of working from home
• Unlimited time off
• Employer-paid health insurance plans
• Dental and vision offered at very low premiums
• Generous stock options, vested over 4 years
• 401k match
• Monthly wellness stipend

About the company

MagicSchool is a generative AI platform for teachers with more than 7 million users. It is a fast growing company working towards real social impact.