Whitecircle

Multimodal ML Engineer

Paris, Remote. Posted 4 months ago

The role

You will train and fine-tune large-scale multimodal models including vision, audio, video, and speech. You will also build data pipelines, design experiments, and deploy models to production for an AI safety platform.

What you will do

  • Train and fine-tune large-scale multimodal models from scratch and from pretrained checkpoints
  • Extend models across modalities including image understanding, video temporal modeling, long-context processing, and streaming audio
  • Design and run experiments including architecture changes, data mixes, and training recipes
  • Build and maintain multimodal data pipelines
  • Train and optimize MoE architectures for efficient multimodal inference
  • Build alignment pipelines including SFT, DPO, GRPO, and reward modeling
  • Optimize models for production through quantization, distillation, batching, streaming and low-latency serving
  • Deploy models end-to-end from research checkpoint to production serving
  • Define evaluation metrics and benchmarks

Required qualifications

  • 3+ years training large-scale deep learning models in multimodal domains
  • Strong PyTorch skills with hands-on distributed training experience
  • Deep experience with multimodal architectures
  • Hands-on with RLHF/alignment for multimodal
  • Experience with video and/or audio sequence modelling
  • Track record of shipping models to production
  • Comfortable with large-scale multimodal dataset curation
  • Familiar with MoE architectures and their trade-offs
  • Strong engineering fundamentals including clean code, version control, testing, and documentation

Nice to have

  • Understanding of audio signal processing fundamentals

Benefits

  • Competitive compensation package, including equity
  • Flexible time off
  • Paid time off in line with your local regulations
  • Relocation package for Paris
  • Best medical insurance in France
  • Learning and development support for courses, conferences, and opportunities to grow your skills
  • All the hardware, tools, and services you need
  • Covered subscriptions for AI agents and IDEs
  • Team off-sites twice a year

Before you apply

  • Introductory call with HR
  • Take-home test assignment
  • Technical interview with Head of Applied Research
  • Final conversation with CEO

About the company

White Circle is an AI Safety company building the safety, reliability, and optimization layer for AI systems. They process over 100M+ API calls every month and fine-tune their own LLMs.

Multimodal ML Engineer at Whitecircle | JobZoey