Judgmentlabs

Member of Technical Staff, Deployment Engineer

San Francisco. Posted 25 days ago

The role

You will own the end-to-end customer process by building evals and monitoring in Judgment. You will partner with AEs, deploy the ABM platform into customer codebases, and turn customer feedback into product direction.

What you will do

  • Partner with AEs on technical sales through discovery and demos
  • Deploy and embed the ABM platform and AI components into customer codebases and production AI systems
  • Guide customers through technical decisions around agent monitoring and evaluation strategy
  • Own multiple customer engagements end-to-end via Slack and calls
  • Turn feedback across customers into product direction
  • Prototype and demo new features with coding agents
  • Ship PRs and work with engineering to get changes shipped

Required qualifications

  • Experience deploying AI or LLM-based systems into real production environments
  • Ability to quickly learn new tools and systems and integrate AI infrastructure into customer workflows and codebases
  • Ability to translate ambiguous customer goals into concrete technical solutions and evaluation strategies
  • Strong product sense
  • Comfort prototyping and shipping changes quickly with coding agents
  • Strong customer-facing skills
  • Comfort owning customer engagements end-to-end

Nice to have

  • You want to be a technical founder in the future

Benefits

  • Full benefits
  • Equinox
  • A private chef

About the company

Judgment Labs is building the infrastructure for continual learning in long-horizon AI agents. They have raised $32M across two rounds led by Lightspeed.

Member of Technical Staff, Deployment Engineer at Judgmentlabs | JobZoey