Sr. Product Manager, AI

Remote. Posted a month ago

The role

You will manage member-facing AI behavior and own Flodesk's prompts, agent instructions, and evaluation practices. You will work with engineers to shape how AI systems behave to help small business owners with marketing campaigns.

What you will do

Manage member-facing AI behavior across prompt-to-create, agentic editing and future jobs.
Create, test, version and document prompts and agent instructions.
Define context, member data, tools and product state needs for AI.
Own Flodesk's AI evaluation practice including datasets, scenarios, rubrics, coverage and human review.
Run the recurring evaluation and quality-monitoring process independently.
Review traces and AI interactions to diagnose failures.
Turn research, feedback, analytics and failures into priorities and experiments.
Own the day-to-day product direction and learning agenda for Flodesk's AI experience.

Required qualifications

Shaped or meaningfully improved real LLM or agentic products.
Practical knowledge of prompts, context, tools, agent behavior and evaluation.
Hands-on with prompt iteration, evaluation tools and trace review.
Comfortable working with JSON, schemas and structured outputs.
Strong product judgment.
Ability to design representative test sets and build failure taxonomies.
Ability to think in systems and reusable patterns.
Ability to communicate clearly across technical and non-technical disciplines.

Nice to have

Owned AI product behavior, conversation design, computational linguistics or prompt systems
Built content-generation, creative or marketing tools
Used Langfuse, Braintrust or comparable evaluation and observability platforms
Worked on products for small businesses, creators or marketers

Benefits

Fully paid health insurance for individual coverage
16 weeks paid parental leave for non-birthing parents
22 weeks paid maternity leave for birthing parents
Unlimited flexible time off
401(k) match (US employees only)
$1,000 annual stipend for learning and development

About the company

Flodesk is an email marketing company built to help entrepreneurs sell online and design emails. It is a remote-first company with a globally distributed team.