Xai

Sr. Analyst, Safety Operations (Child Safety)

Austin, TX; Bastrop, TX. Posted 7 months ago

The role

You will monitor and act on content and behavior that breaks the terms of service, with a main focus on protecting minors. You will investigate complex child safety cases, escalate when needed, and help train and refine Grok.

What you will do

  • Monitor and take action on content and behavior that goes against the terms of service, escalating as needed
  • Investigate complex child safety cases and decide when to escalate to legal teams or external reporting (e.g., NCMEC reports)
  • Respond to time-sensitive escalations in high-impact, often ambiguous situations
  • Process appeals, audit automations, and label use cases in the system
  • Provide labels, annotations, and inputs on safety protocols, risk scenarios, and policy compliance
  • Support high-quality curated data that reinforces the company's rules and ethical alignment
  • Give feedback on tasks that improve AI defenses to detect illegal and unethical behavior
  • Interpret and apply safety policies
  • Propose solutions to increase security and safety of the platform

Required qualifications

  • 3+ years of professional experience in online child safety, criminal investigations, Trust & Safety operations, or another safety field
  • Experience improving Large Language Models (LLMs), specifically related to Child Sexual Exploitation (CSE)
  • Exposure to sensitive or graphic content may be part of the role
  • Must be a U.S. citizen or national, U.S. lawful permanent resident, refugee under 8 U.S.C. § 1157, or asylee under 8 U.S.C. § 1158, or be eligible to obtain the required authorizations from the U.S. D

Nice to have

  • Proven expertise in identifying, mitigating, and preventing CSAM and CSE, including grooming behaviors and risks in AI-generated content, with knowledge of legal obligations such as NCMEC reporting
  • Proven experience in online safety and reducing harm while preserving Free Speech
  • Skills in analyzing complex scenarios, ethical reasoning, and risk assessment
  • Strong communication, interpersonal, analytical, and ethical decision-making skills
  • Data analysis expertise to identify emerging abuse vectors and design automations
  • Trust and Safety experience at a social media company, using AI or automation tools
  • Experience collaborating with child safety organizations (such as NCMEC) or developing classifiers for CSAM/CSE
  • Red-teaming and adversarial testing of LLMs to find novel abuse vectors and jailbreaks

Before you apply

  • Must meet U.S. export regulation (ITAR) citizenship or status requirements, or be eligible to obtain the required authorizations from the U.S. Department of State
Sr. Analyst, Safety Operations (Child Safety) at Xai | JobZoey