Handshake
Senior Software Engineer - AI Data (USA)
Remote (USA). Posted 4 days ago
The role
Senior Engineers identify where frontier models fail by working through real problems from a codebase step by step. You will judge AI work by reviewing agent output like a pull request and pairing with the AI on tasks.
What you will do
- Judge the AI's work.
- Give an agent a real ticket, then review its output like a teammate's pull request: run it, evaluate it.
- Pair with the AI on your own task.
- Work a real problem from a codebase you know, step by step, and flag where the model goes wrong.
Required qualifications
- 4+ years of professional software engineering experience
- A Bachelor's or Master’s degree in computer science or a related field
- US work authorization
- Strong written English
- 40 hours a week to give during your contract
Benefits
- Senior-engineer pay
- Work that lasts
- An elite, hand-picked team
- Priority access to projects frontier labs trust us with
- Direct work with project leads
- Ongoing work on your schedule
- Dedicated team, fast answers, and real feedback
Before you apply
- Pass a proctored coding assessment, without the use of AI tools.
- Complete one paid trial task.
About the company
Handshake powers 25 million job seekers, 1 million+ employers, and 1,600 educational institutions. Handshake AI works directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data.