Audio Specialist- Freelance AI Trainer Project

The role

This person will create and execute role-play evaluation scenarios to assess advanced agentic audio models. The work involves evaluating model performance for customer support use cases across various domains.

What you will do

• Create and execute role-play–based evaluation scenarios simulating customer service interactions.
• Contribute to the development of diverse and representative datasets.
• Evaluate model performance across a standardized set of qualitative and quantitative metrics.
• Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.

Required qualifications

• Basic computer programming literacy
• Understanding of JSON structures
• Familiarity with functions and methods
• Ability to reason about structured data and simple logic
• Technical communication clarity when handling support-style problem-solving
• Strong verbal communication skills in a simulated customer support context
• English proficiency including fluency across all language skills: reading, listening, writing, and speaking
• Access to a high-quality microphone
• Comfort working with structured prompts, evaluation rubrics, and technical guidelines
• Device capable of running audio recording software and opening large technical documentation

Before you apply

• As a contractor you’ll supply a secure computer and high-speed internet

About the company

The employer is agency.