Agency

Attorney Specialist - Freelance AI Trainer Project

United States of America. Posted 15 months ago

The role

You will engage in substantive legal dialogue with AI models to assess responses for factual and analytical rigor. You will challenge models with realistic legal scenarios and document performance gaps to improve reasoning.

What you will do

  • Engage in substantive legal dialogue with the model
  • Assess responses for factual and analytical rigor
  • Identify reproducible failure points
  • Collaborate with the team to refine prompts and improve evaluation metrics
  • Challenge AI models with realistic legal scenarios
  • Assess model reasoning
  • Identify opportunities for improvement
  • Document performance gaps to strengthen model reasoning

Required qualifications

  • JD or equivalent legal degree
  • Significant litigation experience gained in practice, academia, government, or related fields
  • Ability to articulate legal reasoning clearly and precisely

Nice to have

  • History of publication
  • Prior clerkships
  • Teaching experience
  • Subject matter specialization

Before you apply

  • As a contractor you will supply a secure computer and high-speed internet
Attorney Specialist - Freelance AI Trainer Project at Agency | JobZoey