Sr. Analyst, Safety Operations (Child Safety)

The role

You will monitor and act on content and user behavior that goes against the terms of service, with a primary focus on protecting minors. You will investigate child safety cases, escalate when needed, and help train and refine Grok.

What you will do

• Monitor and take action on content and behavior that goes against the terms of service, escalating as needed
• Investigate complex child safety cases, including escalation to internal legal teams and external reporting (e.g., NCMEC reports when applicable)
• Respond to time-sensitive escalations in high-impact, often ambiguous situations
• Process appeals, audit automations, and label use cases in the system
• Provide labels, annotations, and inputs on safety protocols, risk scenarios, and policy compliance
• Support delivery of high-quality curated data that reinforces the company's rules and ethical alignment
• Collaborate with team members to give feedback that improves AI defenses against illegal and unethical behavior
• Interpret and apply safety policies effectively
• Maximize efficiencies in enforcement and support, and propose solutions to increase platform safety

Required qualifications

• 3+ years of professional experience in online child safety, criminal investigations, Trust & Safety operations, or another safety field
• Experience improving Large Language Models (LLMs), specifically related to Child Sexual Exploitation (CSE)
• U.S. citizen or national, U.S. lawful permanent resident, refugee, or asylee, or eligible to obtain the required authorizations from the U.S. Department of State (ITAR)
• Comfort with exposure to sensitive or graphic content, including vulgar language, violent threats, pornography, and graphic images

Nice to have

• Proven expertise in identifying, mitigating, and preventing CSAM and CSE, including grooming behaviors and risks in AI-generated content, with knowledge of legal obligations such as NCMEC reporting
• Proven experience in online safety and reducing harm while preserving Free Speech
• Proficiency in analyzing complex scenarios, with strong ethical reasoning and risk assessment skills
• Experience in Trust and Safety for a social media company, leveraging AI or other automation tools
• Experience collaborating with child safety organizations (such as NCMEC) or developing classifiers for CSAM/CSE
• Expertise in red-teaming and adversarial testing of Large Language Models to identify novel abuse vectors, jailbreaks, and safety failure modes
• Expertise in data analysis to identify emerging abuse vectors and design automations that strengthen enforcement
• Strong communication, interpersonal, analytical, and ethical decision-making skills
• Commitment to continuous improvement of processes that prioritize safety and risk mitigation

Benefits

• Equity
• Comprehensive medical, vision, and dental coverage
• 401(k) retirement plan
• Short and long-term disability insurance
• Life insurance
• Various other discounts and perks

Before you apply

• U.S. export rules (ITAR) require you to be a U.S. citizen or national, a green card holder, a refugee, or an asylee, or be eligible to get the required authorizations from the U.S. Department of State
• The role may involve exposure to sensitive or graphic content

About the company

xai is building Super Intelligence, including Colossus supercomputers, Grok models, and applications such as Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. The company describes its mission as helping humanity understand the universe and making life multiplanetary.