Happyrobot.Ai
Founding Data Scientist
San Francisco, Remote. Posted 12 days ago
The role
You will make data a core part of building and improving HappyRobot's products. You will work with Product, Engineering, and Machine Learning teams to measure model, agent, and product feature performance through metrics, experiments, and deep analysis.
What you will do
- Define and track product, feature, and agent-level metrics.
- Design, run, and interpret A/B tests for model changes, prompts, agent behavior, workflows, and product features.
- Measure how agent performance affects client outcomes.
- Connect offline model evaluations with production performance and real-world customer impact.
- Conduct deep analyses across conversations, workflows, and product usage.
- Investigate anomalies and regressions and perform root-cause analyses.
- Build statistical models, simulations, and analytical frameworks.
- Partner with Engineering to improve instrumentation, data quality, and analytical data models.
- Build dashboards and self-serve tools.
- Communicate findings and recommendations to technical and non-technical stakeholders.
Required qualifications
- 4+ years of experience in Data Science, Product Analytics, or another highly quantitative product role.
- Strong experience with experimental design, A/B testing, statistics, causal inference, and hypothesis-driven analysis.
- Advanced proficiency in SQL and Python.
- Experience defining and operationalizing product and feature metrics.
- Ability to translate ambiguous product questions into rigorous analyses and actionable recommendations.
- Strong product instincts and the ability to distinguish statistical significance from meaningful product or customer impact.
- Experience partnering closely with Product, Engineering, or Machine Learning teams.
- Strong written and verbal communication skills.
- High attention to detail and commitment to analytical accuracy.
- Founder mindset: ownership, independence, curiosity, and willingness to go deep.
Nice to have
- Experience working with large language models, AI agents, generative AI, or other probabilistic ML products.
- Experience measuring the production impact of model, prompt, retrieval, or orchestration changes.
- Familiarity with ML evaluation systems and the relationship between offline evaluations and online metrics.
- Experience analyzing conversational, NLP, speech, or other unstructured data.
- Experience with enterprise or B2B products.
- Experience combining quantitative analysis with qualitative methods such as conversation reviews, customer feedback, surveys, or user research.
- Familiarity with modern analytics infrastructure, data warehouses, experimentation platforms, and business intelligence tools.
- Prior experience in a fast-growing startup or other highly ambiguous environment.
Benefits
- Healthcare
- Dental
- Vision coverage
- Competitive salary
- Equity in a high-growth startup
About the company
HappyRobot is the infrastructure for enterprises to build and orchestrate AI workforces. Born in Y Combinator (S23) and backed by a16z, Base10, Prysm Capital and Eurazeo, they power critical operations for global enterprises worldwide.