Member of Technical Staff - RL Environments

The role

You will build new RL environments targeting different agentic capabilities and industry areas. You will train and evaluate agents in these environments and work to improve both agents and environments.

What you will do

• Build new RL environments targeting different agentic capabilities and industry areas
• Train and evaluate agents in those environments
• Make all the pieces work together: tasks, data, tool implementations, and verifiers
• Work across modeling and product to identify gaps in agent performance, and improve both the agents and the environments
• Work with external vendors to create high-quality, expert-built RL environments, and build tools to ensure high task, data, and verifier quality
• Automate the discovery of model capability gaps, and systematically measure agent performance during evals and training

Required qualifications

• Engineered agents and optimized them for specific industry use cases
• Spent dozens of hours reviewing agent trajectories to pinpoint exact failure points and fix them with model training or harness engineering
• Obsess over measuring agentic capabilities and turning that into a repeatable process
• Translated debates about good outcomes from an AI agent into verifier implementations and tuned reward designs
• Designed and run annotation workflows to surface insights into agent performance and verify data quality
• Built synthetic data pipelines to scale eval and training efforts
• Use agents in daily work

Nice to have

• experience with training with RL: scaling, troubleshooting and tuning the environments

Benefits

• Weekly lunch stipend of $75/£75 or equivalent
• Full health and dental benefits, including a separate budget for mental health
• RRSP matching, 401K, Pension Scheme
• 100% Parental Leave top-up for up to 6 months
• Annual enrichment benefits: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit
• Education & learning stipend for conferences, courses, and coaching
• 6 weeks of paid vacation
• Budget for traveling to other offices if remote
• Annual company offsite
• Daily lunch program, snacks, and regular community and social events for those in office
• Co-working benefit for those not near an office
• $500 home office stipend

About the company

Cohere is a security-first enterprise AI company that builds foundation AI models and end-to-end products. It is a global technology company headquartered in Toronto.