Plaud
Machine Learning Engineer, Speech LLM Training - San Francisco
San Francisco, CA, Remote. Posted 6 months ago
The role
The Machine Learning Engineer will build and train large-scale audio or speech models. This role involves designing sequence modeling architectures and debugging distributed training clusters.
What you will do
- Build and train large-scale audio or speech models from the ground up
- Design novel sequence modeling architectures
- Debug distributed training clusters
- Traverse the entire stack from signal processing to foundation model training and edge-device optimization
- Take extreme ownership of ambiguous problems and drive them into production
Required qualifications
- Proven track record of building and training large-scale audio or speech models from the ground up
- Deep expertise in PyTorch or JAX
- Experience optimizing large-scale distributed training runs
- Experience managing GPU memory utilization
- Experience resolving complex performance bottlenecks
Nice to have
- Hands-on experience with core text-based Large Language Model pretraining, instruction tuning, or RLHF
- Hands-on experience designing and training state-of-the-art neural audio codecs
- Designing and training diffusion models, flow matching, or autoregressive architectures for speech and voice generation
- Applying Reinforcement Learning (RL) techniques like RLHF or GRPO
- End-to-end inference and performance optimization using high-throughput serving frameworks
- Managing massive GPU clusters
- Utilizing advanced distributed training frameworks like FSDP or DeepSpeed
- Navigating orchestration tools like Kubernetes
Benefits
- Top-tier healthcare for employees and dependents, including dental and vision
- Employer subsidy for healthcare
- 401(k) plan with company matching
- Unlimited PTO
- 13 paid holidays
- 12 weeks of paid new parent leave
- Choice of top-of-the-line laptops/workstations
- Annual offsites
- Fully stocked office
About the company
Plaud is a San Francisco-based company building the real-world AI interface for professionals. It is a bootstrapped, profitable company with a $300M revenue run rate.