Machine Learning Engineer, Voice Conversion

The role

You will build state-of-the-art speech systems end-to-end, from data specifications through production inference. You will drive the model, data, and evaluation flywheel for voice conversion and adjacent tasks.

What you will do

• Architect, implement, pre-train, fine-tune, and post-train/alignment for large-scale speech models.
• Design, run, and analyze scientific experiments.
• Develop and improve dev tooling.
• Contribute to the entire stack from low-level optimizations to high-level model design.
• Define data requirements and collaborate on acquisition, curation, augmentation, labeling quality, and synthetic data strategies.
• Design automated objective and subjective evaluations.
• Harden the training, evaluation, and inference pipeline.
• Contribute to safety/consent guardrails and misuse/abuse mitigation.

Required qualifications

• Exceptional research/development experience with large-scale audio models (>8B parameters, >500k hours of data).
• Deep hands-on experience with diffusion and/or flow-matching transformers, including practical knowledge of samplers, schedules, conditioning mechanisms, and distillation.
• Deep hands-on experience training audio VAEs, neural audio codecs, and vocoders latent/tokenizer design, reconstruction and perceptual objectives, adversarial training.
• Strong experience with multi-node, multi-GPU distributed training (FSDP/DeepSpeed or equivalent).
• Strong software engineering skills with a proven track record of building complex systems.
• Strong with PyTorch and performance work (profiling, CUDA/Triton/C++ as needed) and writing reliable production-quality code.
• Shipped large-scale speech/audio or multimodal generative models to production.
• Background in working with large-scale ML data, and the ability to iterate on data and triangulate quality using both subjective and objective signals.
• Experience with voice cloning, speech control/steerability, or expressive speech generation.
• Notable publications and/or open-source contributions in speech/audio/ML.

Benefits

• Competitive salary and generous company equity
• Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
• 42 days of paid time off, including: 15 PTO days, 10 sick days, 15 company holidays, 2 floating holidays
• Generous parental leave & fertility support
• 401(k) retirement savings plan
• Lifestyle spending account – $500/month
• Complimentary lunch and snacks for in-office employees
• One Medical membership

About the company

Cantina is a new social platform founded by Sean Parker with the most advanced AI character creator. Their bots are lifelike, social creatures that can interact across voice, video, and text.