Machine Learning Engineer, TTS

The role

You will build state-of-the-art speech systems end-to-end, from data specs through production inference. You will drive the model, data, and evaluation flywheel for TTS and adjacent tasks.

What you will do

• Architect, implement, pre-train, fine-tune, and post-train/alignment for large-scale speech models.
• Independently lead small research projects while collaborating on larger team initiatives.
• Design, run, and analyze scientific experiments.
• Develop and improve dev tooling.
• Contribute to the entire stack from low-level optimizations to high-level model design.
• Define data requirements and collaborate on acquisition, curation, augmentation, labeling quality, and synthetic data strategies.
• Design automated objective and subjective evaluations.
• Harden the training, evaluation, and inference pipeline.
• Partner with infrastructure to run distributed training/inference on cloud fleets.
• Contribute to safety/consent guardrails and misuse/abuse mitigation.

Required qualifications

• Exceptional research/development experience with large scale audio models (>3B models and >500k hours data).
• Exceptional understanding and hands-on experience with transformer architectures and/or diffusion models (inc. distillation and streaming) and/or audio language modelling.
• Strong experience with multi-node and multi-gpu distributed model training.
• Strong software engineering skills with a proven track record of building complex systems.
• Strong with PyTorch and performance work (profiling, CUDA/Triton/C++ as needed) and writing reliable production quality code.
• Shipped large scale speech/audio models to production.
• Background in working with large-scale ML data.
• Ability to iterate on data, and triangulate quality using subjective and objective signals.
• Notable publications and/or open source contributions in speech/audio/ML.
• Experience with voice-cloning, speech-control, voice-generation.

Nice to have

• Shipped large scale speech/audio models (TTS/VC/ASR) to production.
• Work on large-scale ML systems.
• Experience with audio language modelling, transformer architectures.
• Experience with voice-cloning, speech-control, voice-generation.
• Background in processing large-scale ML data.
• Publications or notable open-source in speech/audio/ML.

Benefits

• Competitive salary
• Generous company equity
• Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
• 42 days of paid time off, including: 15 PTO days, 10 sick days, 15 company holidays, 2 floating holidays
• Generous parental leave & fertility support
• 401(k) retirement savings plan
• Lifestyle spending account – $500/month
• Complimentary lunch and snacks for in-office employees
• One Medical membership

About the company

Cantina is a new social platform founded by Sean Parker with the most advanced AI character creator. Their bots are lifelike, social creatures that can interact across voice, video, and text.