Cohere

Member of Technical Staff, Training Performance Engineer

London, Remote. Posted 21 months ago

The role

You will optimize the performance of advanced language models and systems. You will focus on improving training throughput and ensuring high accelerator utilization.

What you will do

  • Design and write high-performant and scalable software for training.
  • Understand architectural modifications and design choices and their effects on training throughput and quality.
  • Write low-level CUDA, triton kernels to squeeze every last bit of performance from our accelerators.
  • Research, implement, and experiment with ideas on our supercompute and data infrastructure.
  • Learn from and work with the best researchers in the field.

Required qualifications

  • Extremely strong software engineering skills.
  • Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR.
  • Experience writing kernels for GPUs using CUDA, triton, etc
  • Experience using large-scale distributed training strategies.
  • Familiarity with autoregressive sequence models, such as Transformers.

Nice to have

  • paper at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)

Benefits

  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
  • Full health and dental benefits, including a separate budget for mental health.
  • RRSP matching, 401K, Pension Scheme.
  • 100% Parental Leave top-up for up to 6 months, for either parent.
  • Annual enrichment benefits: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
  • Education & learning stipend for conferences, courses, and coaching.
  • 6 weeks of paid vacation (30 working days!)
  • Budget for traveling to other offices if you are remote, plus an annual company offsite.
  • Daily lunch program, plenty of snacks, and regular community and social events for those in the office.
  • A co-working benefit for those not near an office.
  • A $500 home office stipend.

About the company

Cohere is a security-first enterprise AI company that builds foundation AI models and end-to-end products. It is a global technology company headquartered in Toronto.