Human Data Quality Analyst, AI Business

The role

You will perform analytical work to ensure human data captures the right signal for AI models. You will investigate quality shifts, run statistical analyses, and provide practical recommendations to improve data collection and quality controls.

What you will do

• Run day-to-day quality measurement across live human-data programmes.
• Investigate quality issues to distinguish individual errors from wider problems.
• Help build the data-quality pipeline alongside quality engineers.
• Turn complex analysis into clear reporting and visualisations for stakeholders.
• Support new programmes from design through to launch by developing rubrics, guidelines, and gold sets.
• Use learnings from live programmes to improve annotation design, guidance, training and quality processes.

Required qualifications

• 1 to 2 years of practical experience analysing real data in an analytical, quality, research or data-focused role.
• Can use SQL and Python to write queries and analysis.
• Can apply statistical concepts such as sampling, distributions and variability.
• Can turn evidence into a clear account with practical recommendations for non-technical colleagues.
• Can assess detailed work carefully and consistently while looking for patterns.
• Can test a sensible approach and document reasoning when the right method is unclear.

Nice to have

• Experience working with data produced or judged by people, such as annotation, data labelling, research coding, content review or survey research.
• Knowledge of psychology, behavioural science, linguistics or a related field.
• An understanding of how human data supports model training and evaluation.
• Experience creating clear data visualisations or dashboards.

Benefits

• Competitive salary
• Equity
• Benefits
• Opportunity to earn a cash variable element, such as a bonus or commission
• Hybrid working

About the company

Prolific provides human data infrastructure to train the next generation of AI models. The platform connects researchers and companies with a global, ethically curated participant base.