MTS, Post-Training (Enterprise)

The role

This role focuses on standing up enterprise post-training capabilities. You will ship custom models to enterprise customers by curating data, building evaluation suites, and fine-tuning models.

What you will do

• Ship enterprise-grade models.
• Build bespoke evaluation suites.
• Curate and filter high-impact datasets.
• Manage and mitigate regression risk.
• Engage directly with stakeholders.
• Deploy for cost and privacy.
• Direct frontier tools and workflows.

Required qualifications

• Post-trained at least one LLM that was deployed to real users in production.
• Demonstrated experience building benchmarks, creating eval datasets, and getting stakeholders to agree on clear metrics.
• Deep understanding of regression risks.
• Experience collaborating directly with non-ML stakeholders, enterprise customers, or product managers.
• Fluency in modern post-training frameworks, data processing pipelines, and code bases designed for production deployment.
• Ownership mindset for the full post-training lifecycle.

Nice to have

• Post-trained conversational or task-oriented assistants
• Built LLM judges or reward models and calibrated them against human raters
• Operated a production data flywheel
• Extensive hands-on experience with open-weight models (Llama, Qwen, Mistral, DeepSeek)
• Forward-deployed engineer (FDE), founder, or early-stage startup backgrounds

Benefits

• Health, dental, and vision coverage
• 401(k)
• Daily onsite lunch provided
• Visa sponsorship and relocation support available
• Direct impact on how the industry trains and evaluates agents

Before you apply

• Visa sponsorship and relocation support available

About the company

Bespoke Labs is an applied AI research lab pioneering data and RL environment curation for training and evaluating agents.