Member of Technical Staff, North Modelling (Evals)

The role

You will build evaluation systems, feedback loops, and applied modelling workflows for the North AI workspace platform. You will work with product and modelling teams to define measurement standards and guide model updates based on product outcomes.

What you will do

• Own the eval strategy for North across agent workflows and enterprise knowledge work.
• Build high-quality evals from user feedback, production failures, and customer needs.
• Create systems that turn user and customer learning into continuous evals.
• Extract insight from eval results to provide actionable recommendations for central modelling teams.

Required qualifications

• Improved LLM-powered, agent-powered, or AI-product systems through evals, feedback loops, data curation, prompting, model adaptation, or model selection.
• Strong applied MLE judgment regarding model behavior, eval validity, product outcomes, and production tradeoffs.
• Ability to translate qualitative signals into measurement for modelling teams.
• Self-directed and practical with technical depth and product understanding.

Benefits

• Weekly lunch stipend of $75/£75 or equivalent.
• Full health and dental benefits, including a separate budget for mental health.
• RRSP matching, 401K, Pension Scheme.
• 100% Parental Leave top-up for up to 6 months.
• Annual enrichment benefits including arts, culture, fitness/wellness, quality time, and workspace improvement credit.
• Education and learning stipend for conferences, courses, and coaching.
• 6 weeks of paid vacation.
• Budget for traveling to other offices if remote, plus an annual company offsite.
• Daily lunch program, snacks, and social events for in-office employees.
• Co-working benefit for those not near an office.
• $500 home office stipend.

Before you apply

• Must be able to collaborate effectively within Europe and East Coast North America time zones.
• May use AI-enabled tools to screen and assess applicants.

About the company

Cohere is a security-first enterprise AI company that builds foundation AI models and end-to-end products. It is a global technology company headquartered in Toronto.