Senior Member of Technical Staff, Safety and Security for Agents

The role

You will focus on data generation, post-training algorithms, and evaluation methods to ensure safety in next generation Large Language Models. You will work with cross-functional machine learning, data annotation, product, and policy teams.

What you will do

• Evaluate scientific experiments related to data collection and model performance
• Design and conduct data collection tasks including working with human annotators
• Analyze datasets for quality, biases, and suitability for training ML models
• Train large language models on distributed training infrastructures
• Evaluate and improve the generalizability and robustness of ML systems
• Collaborate with cross-functional teams and present findings

Required qualifications

• Strong statistical skills
• Extremely strong software engineering skills
• Strong expertise in designing and conducting data collection tasks
• Experience analyzing datasets for quality, biases, and suitability for training ML models
• Hands-on experience training large language models on distributed training infrastructures
• Familiarity with evaluating and improving the generalizability and robustness of ML systems
• Proficiency in Python and ML frameworks such as PyTorch, TensorFlow, or JAX
• Excellent communication skills

Nice to have

• One or more papers at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)

Benefits

• Weekly lunch stipend of $75/£75 or equivalent
• Full health and dental benefits
• Separate budget for mental health
• RRSP matching, 401K, Pension Scheme
• 100% Parental Leave top-up for up to 6 months
• Annual enrichment benefits for arts & culture, fitness/wellness, quality time, and workspace improvement
• Education & learning stipend for conferences, courses, and coaching
• 6 weeks of paid vacation
• Budget for traveling to other offices if remote
• Annual company offsite
• Daily lunch program and snacks for those in office
• Co-working benefit for those not near an office

About the company

Cohere is a security-first enterprise AI company that builds foundation AI models and end-to-end products. It is a global technology company headquartered in Toronto.