Agency
Attorney Specialist - Freelance AI Trainer Project
United States of America. Posted 15 months ago
The role
You will engage in substantive legal dialogue with AI models to assess responses for factual and analytical rigor. You will challenge models with realistic legal scenarios and document performance gaps to improve reasoning.
What you will do
- Engage in substantive legal dialogue with the model
- Assess responses for factual and analytical rigor
- Identify reproducible failure points
- Collaborate with the team to refine prompts and improve evaluation metrics
- Challenge AI models with realistic legal scenarios
- Assess model reasoning
- Identify opportunities for improvement
- Document performance gaps to strengthen model reasoning
Required qualifications
- JD or equivalent legal degree
- Significant litigation experience gained in practice, academia, government, or related fields
- Ability to articulate legal reasoning clearly and precisely
Nice to have
- History of publication
- Prior clerkships
- Teaching experience
- Subject matter specialization
Before you apply
- As a contractor you will supply a secure computer and high-speed internet