Software Engineer - Training Product

The role

You will own features like multi-node training and products like serverless reinforcement learning from conception to GA. You will work through the stack, architecting solutions from API and UI down to the infrastructure layer.

What you will do

• Iterate like crazy
• Design ergonomic APIs and abstractions to model complex resources and lifecycles
• Work throughout the stack to implement features
• Fine-tune and deploy models to develop intuition around training workflows
• Partner closely with model developers and research engineers
• Drive long-term improvements to improve reliability of systems and velocity of development
• Fix bugs & resolve customer issues with urgency

Required qualifications

• 5+ years experience building software applications
• Deep knowledge of the web stack, databases, and distributed systems
• Experience developing developer tooling or infrastructure products for external or internal users
• Good taste in product, particularly developer-oriented tools
• Interest in ML/AI infrastructure and willingness to learn
• Driven by high agency and ownership
• Strong communication skills with the ability to bridge technical depth and business needs

Nice to have

• Experience launching features and products through different release cycles (MVP, Beta, GA, etc.)
• Experience with model development methods and paradigms, like Supervised Fine-Tuning, Reinforcement Learning, Synthetic Data Generation, LoRA, Full Finetunes, etc.
• Familiarity or experience with the open source training stack and frameworks (NCCL, PyTorch, Megatron, NemoRL, VeRL, Axolotl, HF Trainer) and distributed training techniques (FSDP, DeepSpeed)
• Experience developing AI products, tooling, or agents
• Frontend fluency

Benefits

• Competitive compensation, including meaningful equity
• 100% coverage of medical, dental, and vision insurance for employee and dependents (U.S. only)
• Flexible PTO policy including company wide Winter Break
• Paid parental leave
• Fertility and family-building stipend through Carrot
• Company-facilitated 401(k) (U.S. only)
• Exposure to a variety of ML startups

About the company

Baseten powers mission-critical inference for the world's most dynamic AI companies. They build a platform that enables companies to bring cutting-edge models into production.