Datasnipper

Senior Technical Product Manager, Agent Builder

New York, Remote. Posted 8 days ago

The role

You will own the Agent Builder strategy and roadmap. You will design the harness for agents, build feedback loops, and set quality gates for agent release.

What you will do

  • Own the Agent Builder strategy and roadmap
  • Design the harness with engineering
  • Decide what builders control and what the platform sets
  • Build the feedback loops
  • Set the quality gates an agent must pass before release
  • Report agent quality with a stated method and sample
  • Prototype in code before writing specs
  • Write short specs and decision memos
  • Turn forward-deployed team learnings into product

Required qualifications

  • A technical background: software, ML or infrastructure engineering, or several years as a technical PM on developer or AI platforms
  • Hands-on experience shipping agent systems in production: context and retrieval, tool calling, orchestration, structured outputs, retries and fallbacks
  • Eval practice: building datasets, calibrating LLM judges against human labels, offline and online evaluation, and regression testing across model versions
  • Observability for LLM systems: traces, cost and latency, and classifying failures
  • System design skills: schemas, versioning, permissions, event logs and APIs
  • PM experience on a product that other people build on
  • Prototyping in code with AI tools as part of your normal work
  • Clear, short writing

Nice to have

  • Audit or accounting knowledge, from practice or from building products for auditors, finance teams or other experts in regulated fields
  • Document AI: extraction, OCR, grounding and citation
  • You've built an agent harness or framework, eval tooling, or LLM observability
  • You've built review workflows or feedback pipelines that turn user corrections into eval or training data
  • Experience with low-code tools, workflow designers, rule engines or DSLs
  • Design-partner programmes with large enterprise customers

Benefits

  • Equity (Stock Appreciation Rights)
  • Flexible paid time off
  • Comprehensive medical and dental coverage
  • 401K match
  • Paid parental leave
  • Company-sponsored lunch
  • Access to continuous learning and development initiatives
  • Access to the mental health and wellness platform
  • Multiple social activities for team building

Before you apply

  • Recruitment Screen (30 minutes, online)
  • Hiring Manager Interview (30 minutes, online)
  • Panel Presentation (60 minutes, online)
  • Leadership interview (30 minutes, online)
  • Final Interview (30 minutes, online)

About the company

DataSnipper builds AI solutions that empower audit and finance professionals. The company is a high-growth scale-up with a platform used by over 600,000 professionals across 3,000+ organizations.