Software Engineers: Paid Interview on AI Evaluation Tasks

The role

You will review programming tasks and evaluation harnesses for AI testing. You will assess technical accuracy, complexity, and realism of coding challenges.

What you will do

• Review and assess the quality of realistic programming tasks
• Evaluate coding environments and technical harnesses for AI testing
• Walk through potential flaws in the provided code structures
• Provide feedback on the difficulty and realism of the challenges

Required qualifications

• Professional experience as a software engineer or developer
• Familiarity with building or verifying programming tasks
• Experience with code review and evaluation harnesses
• Comfortable discussing technical architecture and testing methodologies

About the company

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.