AI Coding Evaluator

The role

You will evaluate the technical accuracy, language quality, and usefulness of AI-generated responses. This includes reviewing customer service responses and technical content.

What you will do

• Review AI-generated customer service responses and technical content.
• Evaluate responses for clarity, helpfulness, natural language, and overall quality.
• Assess technical correctness using coding knowledge.
• Read, validate, and troubleshoot JSON.
• Check outputs for formatting accuracy and adherence to project guidelines.
• Provide clear, well-reasoned feedback explaining evaluations.

Required qualifications

• Fluency in one or more of the supported language varieties: Dutch (Netherlands), Welsh (United Kingdom), French (Canada), German (Germany), Italian (Italy), Portuguese (Brazil), or Greek (Greece).
• A solid understanding of JSON, including syntax, structure, validation, and troubleshooting.
• Coding knowledge sufficient to assess technical content and identify errors.
• Strong judgment when evaluating customer service responses.
• Excellent attention to detail and strong written communication skills.
• Ability to follow detailed evaluation guidelines consistently.

Nice to have

• Previous experience in AI evaluation, quality assurance, or technical support.
• Experience working with APIs and structured data.
• A background in customer service, software development, or technical writing.

About the company

Anyone AI creates high-quality training and evaluation data for frontier AI models.