Member of Technical Staff, Integration/RL Team (Research Engineer)

The role

The integration team develops and scales machine learning algorithms and infrastructure for LLM post-training, focusing on large-scale, distributed RL methods. This role involves implementing tools to support research, optimizing post-training algorithms, and scaling distributed RL.

What you will do

• Design and write high-performing and scalable software for training models.
• Develop new tools to support and accelerate research and LLM training.
• Coordinate with other engineering and scientific teams to create an integrated post-training ecosystem.
• Craft and implement techniques to improve performance and speed up training cycles on SFT, offline preference, and the RL regime.
• Research, implement, and experiment with ideas on cluster and data infrastructure.
• Collaborate with other scientists, engineers, and teams.

Required qualifications

• Extremely strong software engineering skills.
• Value test-driven development methods, clean code, and strive to reduce technical debts.
• Proficiency in Python and related ML frameworks such as JAX, Pytorch and/or XLA/MLIR.
• Experience using and debugging large-scale distributed training strategies (memory/speed profiling).

Nice to have

• Experience with distributed training infrastructures (Kubernetes) and associated frameworks (Ray).
• Hands-on experience with the post-training phase of model training, with a strong emphasis on scalability and performance.
• Experience in ML, LLM and RL academic research.

Benefits

• Weekly lunch stipend of $75/£75 or equivalent.
• Full health and dental benefits, including a separate budget for mental health.
• RRSP matching, 401K, Pension Scheme.
• 100% Parental Leave top-up for up to 6 months.
• Annual enrichment benefits: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
• Education & learning stipend for conferences, courses, and coaching.
• 6 weeks of paid vacation.
• Budget for traveling to other offices if remote, plus an annual company offsite.
• Daily lunch program, snacks, and regular community and social events for those in office.
• Co-working benefit for those not near an office.
• $500 home office stipend.

Before you apply

• May use AI-enabled tools to screen and assess applicants.

About the company

Cohere is a leading security-first enterprise AI company that builds foundation AI models and end-to-end products. It is a global technology company headquartered in Toronto.