Zetaglobal

Principal Product Manager

New York, NY. Posted 2 months ago

The role

You will lead the product architecture for agent chaining, orchestration and a shared context graph on the Zeta Marketing Platform. You will define telemetry, evaluation and governance standards, and align Product, Engineering, Data Science and other teams around them.

What you will do

  • Develop and manage the architecture for chaining LLM agents, tools, models and workflows
  • Lead development of a shared Context Graph that gives agents persistent awareness
  • Implement and manage context streaming services with real-time awareness
  • Define the telemetry framework and analyze how agents operate in production
  • Build evaluation frameworks for agent quality, reliability and workflow completion
  • Lead creation of a Model Workbench for marketers and other non-technical users
  • Oversee registration, governance and discoverability of MCP servers, tools and agents
  • Drive alignment across Product, Engineering, Data Science, Design, Analytics, Security and business stakeholders
  • Define platform standards and governance for agents, tools, context and telemetry
  • Troubleshoot and prototype using tools such as LangSmith

Required qualifications

  • Demonstrated experience leading complex technical products involving LLMs, AI agents, workflow systems, developer platforms, ML infrastructure or AI-driven applications
  • Strong understanding of LLM agents, tool use, orchestration, multi-agent workflows and state management
  • Experience with context graphs, knowledge graphs, semantic systems, memory architectures or metadata platforms
  • Strong understanding of instrumentation, telemetry, evaluation and observability for complex AI systems
  • Exceptional ability to align senior stakeholders and cross-functional teams
  • Ability to reason across product, model behavior, data, infrastructure, APIs and operations
  • Strong technical background with hands-on familiarity with LangSmith, APIs, workflow orchestration, LLM agent chaining, MCP and evaluation frameworks
  • Demonstrated ability to troubleshoot ambiguous problems and rapidly prototype solutions
  • Excellent communication skills for technical and non-technical audiences

Nice to have

  • Experience building or operating agentic infrastructure, AI platforms, context platforms, knowledge graphs or developer ecosystems
  • Experience integrating traditional machine learning with generative models and agentic systems
  • Experience with workflow orchestration platforms and distributed systems
  • Experience designing AI telemetry, evaluation systems, experimentation frameworks or production observability for LLM products
  • Demonstrated success establishing cross-functional technical standards and governance
  • Experience building systems where context, telemetry and evaluation form a continuous learning loop

Benefits

  • Unlimited PTO
  • Medical, dental and vision coverage
  • Employee equity
  • Employee discounts
  • Virtual wellness classes
  • Pet insurance

Before you apply

  • Zeta considers applicants without regard to sex, race, color, religion, age, disability, veteran status, national or ethnic origin, sexual orientation or gender identity

About the company

Zeta Global is an AI-Powered Marketing Cloud that uses artificial intelligence and consumer signals to help marketers acquire, grow and retain customers. It was founded in 2007 and is headquartered in New York City with offices around the world.

Principal Product Manager at Zetaglobal | JobZoey