Xai
Sr. Analyst, Safety Operations (Child Safety)
Austin, TX; Bastrop, TX. Posted 7 months ago
The role
You will monitor and act on content and behavior that breaks the terms of service, with a main focus on protecting minors. You will investigate complex child safety cases, escalate when needed, and help train and refine Grok.
What you will do
- Monitor and take action on content and behavior that goes against the terms of service, escalating as needed
- Investigate complex child safety cases and decide when to escalate to legal teams or external reporting (e.g., NCMEC reports)
- Respond to time-sensitive escalations in high-impact, often ambiguous situations
- Process appeals, audit automations, and label use cases in the system
- Provide labels, annotations, and inputs on safety protocols, risk scenarios, and policy compliance
- Support high-quality curated data that reinforces the company's rules and ethical alignment
- Give feedback on tasks that improve AI defenses to detect illegal and unethical behavior
- Interpret and apply safety policies
- Propose solutions to increase security and safety of the platform
Required qualifications
- 3+ years of professional experience in online child safety, criminal investigations, Trust & Safety operations, or another safety field
- Experience improving Large Language Models (LLMs), specifically related to Child Sexual Exploitation (CSE)
- Exposure to sensitive or graphic content may be part of the role
- Must be a U.S. citizen or national, U.S. lawful permanent resident, refugee under 8 U.S.C. § 1157, or asylee under 8 U.S.C. § 1158, or be eligible to obtain the required authorizations from the U.S. D
Nice to have
- Proven expertise in identifying, mitigating, and preventing CSAM and CSE, including grooming behaviors and risks in AI-generated content, with knowledge of legal obligations such as NCMEC reporting
- Proven experience in online safety and reducing harm while preserving Free Speech
- Skills in analyzing complex scenarios, ethical reasoning, and risk assessment
- Strong communication, interpersonal, analytical, and ethical decision-making skills
- Data analysis expertise to identify emerging abuse vectors and design automations
- Trust and Safety experience at a social media company, using AI or automation tools
- Experience collaborating with child safety organizations (such as NCMEC) or developing classifiers for CSAM/CSE
- Red-teaming and adversarial testing of LLMs to find novel abuse vectors and jailbreaks
Before you apply
- Must meet U.S. export regulation (ITAR) citizenship or status requirements, or be eligible to obtain the required authorizations from the U.S. Department of State