Judgmentlabs
Member of Technical Staff, Deployment Engineer
San Francisco. Posted 25 days ago
The role
You will own the end-to-end customer process by building evals and monitoring in Judgment. You will partner with AEs, deploy the ABM platform into customer codebases, and turn customer feedback into product direction.
What you will do
- Partner with AEs on technical sales through discovery and demos
- Deploy and embed the ABM platform and AI components into customer codebases and production AI systems
- Guide customers through technical decisions around agent monitoring and evaluation strategy
- Own multiple customer engagements end-to-end via Slack and calls
- Turn feedback across customers into product direction
- Prototype and demo new features with coding agents
- Ship PRs and work with engineering to get changes shipped
Required qualifications
- Experience deploying AI or LLM-based systems into real production environments
- Ability to quickly learn new tools and systems and integrate AI infrastructure into customer workflows and codebases
- Ability to translate ambiguous customer goals into concrete technical solutions and evaluation strategies
- Strong product sense
- Comfort prototyping and shipping changes quickly with coding agents
- Strong customer-facing skills
- Comfort owning customer engagements end-to-end
Nice to have
- You want to be a technical founder in the future
Benefits
- Full benefits
- Equinox
- A private chef
About the company
Judgment Labs is building the infrastructure for continual learning in long-horizon AI agents. They have raised $32M across two rounds led by Lightspeed.