Cohere

Senior Member of Technical Staff, Multimodal AI

San Francisco, Remote. Posted 23 months ago

The role

This person will design and develop multimodal AI systems by integrating text, speech, and vision. They will conduct research and experiments on advanced compute infrastructure to explore multimodal representation and transfer learning.

What you will do

  • Design and develop cutting-edge multimodal AI systems, integrating various modalities such as text, speech, and vision.
  • Conduct research and experiments on advanced compute infrastructure.
  • Explore novel ideas in multimodal representation learning, transfer learning, and more.
  • Collaborate closely with world-class teams.

Required qualifications

  • Exceptional software engineering skills with a proven track record of building robust and scalable systems.
  • Strong command of Python.
  • Well-versed in popular deep learning frameworks like JAX, PyTorch, and TensorFlow, with an understanding of their multimodal capabilities.
  • Knowledge of distributed training strategies, especially for large-scale multimodal models.
  • Familiarity with autoregressive models, particularly their application in multimodal tasks such as image or video captioning, speech-to-text generation.

Nice to have

  • Publications in top-tier venues demonstrating expertise in multimodal AI research.
  • Experience in writing efficient GPU kernels using CUDA, optimising performance for multimodal tasks.

Benefits

  • Weekly lunch stipend of $75/£75 or equivalent in local currency.
  • Full health and dental benefits, including a separate budget for mental health.
  • RRSP matching, 401K, Pension Scheme.
  • 100% Parental Leave top-up for up to 6 months, for either parent.
  • Annual enrichment benefits: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
  • Education & learning stipend for conferences, courses, and coaching.
  • 6 weeks of paid vacation (30 working days!).
  • Budget for traveling to other offices if remote, plus an annual company offsite.
  • Daily lunch program, snacks, and regular community and social events for those in the office.
  • Co-working benefit for those not near an office.
  • $500 home office stipend.

Before you apply

  • May use AI-enabled tools to screen and assess applicants.

About the company

Cohere is a security-first enterprise AI company that builds foundation AI models and end-to-end products. It is a global technology company headquartered in Toronto.