German Audio Evaluations Specialist - Freelance AI Trainer Project

The role

This person will design evaluation frameworks and provide structured training data for AI benchmark evaluation. They will execute role-play scenarios and audit AI model performance across various domains.

What you will do

• Create and execute complex role-play-based evaluation scenarios.
• Evaluate AI model performance across qualitative and quantitative metrics.
• Assess model basic computer programming literacy including JSON structures, functions, and methods.
• Contribute to the development of diverse audio datasets.

Required qualifications

• Professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Native or bilingual proficiency in German.
• Fluency across reading, listening, writing, and speaking.
• Strong analytical and verbal communication skills.
• Basic computer programming literacy including understanding of JSON structures, functions, methods, and simple logic.
• Meticulous, detail-oriented approach to working with structured prompts and technical guidelines.
• Access to a high-quality microphone.
• Supply a secure computer and high-speed internet.

About the company

agency is sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project.