AI Evaluators: Assessing A Shopping Assistant

The role

AI evaluators will assess the accuracy and helpfulness of a new digital shopping assistant. You will review user interaction traces to identify logical errors and create structured rubrics to judge response quality.

What you will do

• Review real user interaction traces with an AI shopping assistant
• Identify logical failures, inaccuracies, or poor recommendations in the text
• Create structured rubrics and verifiers to judge response quality
• Commit to 20+ hours per week of evaluation work on our internal platform

Required qualifications

• Experience in data evaluation, quality assurance, or AI training
• Strong analytical skills with the ability to spot subtle errors in text
• Familiarity with e-commerce search and digital shopping experiences
• Ability to commit to a sustained workload of 20+ hours per week

Nice to have

• prior experience in prompt engineering
• complex data annotation
• software testing

Before you apply

• Start your paid interview now https://terac.com/interview/start/r/c5aab5ae-fa85-45ab-918d-a8b7cdf9f0ec?utm_source=ashby_listing_description

About the company

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.