Protection Scientist Engineer

The role

You will design and build systems to proactively identify and enforce on abuse on AI products. This includes monitoring product launches, prototyping defense systems, and investigating critical escalations.

What you will do

• Scope and implement abuse monitoring requirements for new product launches.
• Improve processes to sustain monitoring operations for existing products.
• Develop approaches to automate monitoring subtasks.
• Prototype and mature into production systems of detection, review, and enforcement of abuse for major harms.
• Work with Product, Policy, Ops, and Investigative teams to understand key risks.
• Work with Engineering teams to ensure sufficient data and scaled tooling.

Required qualifications

• Ability to work remotely on GMT and must be geographically located in the UK.
• Quantitative and coding background, including statistics/metrics and proficiency in python and SQL.
• Experience in identifying (and ideally enforcing on) bad actors with scaled tooling.
• Ability to be on-call approximately once a quarter that will involve resolving urgent escalations outside of normal work hours, including occasional evenings and weekends.
• Ability to rapidly context switch across domains, modalities, and abuse areas, to include high severity areas like violent activities and child safety.
• Excited to work in a fast paced, ambiguous, and purposeful space with high impact across users and beyond, and to learn quickly.

Nice to have

• Background in machine learning and classification, especially on novel or poorly understood behaviours.
• Experience scaling and automating processes, especially with language models.
• Experience working with scaled labellers or reviewers, particularly at scale.
• Familiarity with one of the following topics/areas: AI safety, child safety, abuse by nation state and other malicious actors, digital mental health, fraud abuse, radicalization/persuasion/grooming; h

Before you apply

• Some detection and investigations may involve exposure to sensitive and distressing content, including sexual, violent, or otherwise-disturbing material.

About the company

10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms.