Judgmentlabs

Member of Technical Staff, Agents

San Francisco. Posted 3 months ago

The role

You will build product experiences and agents for a continual learning loop for long-horizon AI agents. You will own problems end-to-end from customer interaction to building and iterating on products.

What you will do

  • Shape how the Judgment Agent runs large-scale investigations
  • Build the platform for verifying agent changes
  • Design agent investigation interfaces
  • Design Swarm UX for human monitoring of parallel investigations
  • Build workflows that turn production trajectories into datasets, judges, and regression checks
  • Work on the platform including workspaces, roles, permissions, billing, usage, and limits
  • Develop an SDK and terminal-first experience

Required qualifications

  • Experience building and scaling end-to-end production systems, from data layer to UI
  • Strong technical problem-solving skills
  • Builder and tinkerer's mindset with high agency
  • Hands-on experience building with LLMs or agents, or the drive to get there fast
  • Comfort working directly with customers
  • Excellent communication skills
  • Reinforcement learning, post-training, agents, or machine learning fundamentals

About the company

Judgment Labs is building the infrastructure for continual learning in long-horizon AI agents. They have raised $32M across two rounds led by Lightspeed.

Member of Technical Staff, Agents at Judgmentlabs | JobZoey