Pylon

Lead Product Manager, Agent Platform

NYC or Palo Alto (in office). Posted 16 days ago

The role

You will own the Agent Platform by building internal tools for engineers and operators and external APIs for customers. You will set the direction for agents and manage the roadmap for orchestration, retrieval, and guardrails.

What you will do

  • Set the direction for agents across Pylon and align product, engineering, and operations
  • Own the roadmap for core platform pieces like tools, orchestration, context, and memory
  • Speed up internal teams moving from idea to production agents
  • Treat evals as a product with shared datasets, benchmarks, and regression checks
  • Own how external agents work with Pylon via MCP servers, APIs, and permissions
  • Ensure every agent action can be traced and explained for regulators
  • Make build or buy calls on models, vector databases, frameworks, and vendors
  • Write and ship code to the codebase and build agents on the platform
  • Work with GTM and Account Management to support customers and deals
  • Help hire and grow the team as the platform scales

Required qualifications

  • 4+ years as a product manager
  • Owned and scaled a developer platform, infrastructure product, or API used by several teams or outside customers
  • Shipped LLM-based agents or agent tooling to production
  • Know tool use, MCP, multi-agent orchestration, and structured outputs
  • Know evals including golden datasets, LLM-as-judge, and regression testing
  • Understand retrieval including RAG, embeddings, vector databases, chunking, hybrid search, and reranking
  • Understand tradeoffs between prompt and context engineering, model choice, and fine-tuning
  • Familiar with tracing, guardrails, prompt injection, and protecting sensitive data
  • Write code and are comfortable committing to a production codebase
  • Built 0-1 enterprise software in a regulated industry
  • Can write SQL and define metrics
  • Must live in or be willing to relocate to Palo Alto (CA) or New York City

Nice to have

  • An engineering background
  • Mortgage or fintech infrastructure experience
  • Work on document understanding (OCR, extraction, classification)

About the company

Pylon created the first vertically integrated mortgage platform that turns origination into a single API. The company is backed by Peter Thiel, Conversion Capital, QED, Citi, Fifth Wall, and the founders of Ramp, Blend, and Mercury.

Lead Product Manager, Agent Platform at Pylon | JobZoey