Distyl

Research Engineers, Post-Training

San Francisco, Remote. Posted 4 months ago

The role

Research Engineers build the bridge between frontier AI research and production systems. They design and implement compound AI systems, run experiments, and build evaluation frameworks to improve AI system behavior.

What you will do

  • Design and run post-training workflows that improve the behavior, reliability, and usefulness of AI systems
  • Develop datasets, preference signals, evaluation suites, reward models, fine-tuning workflows, and feedback loops
  • Investigate how different post-training techniques affect system behavior across enterprise workflows and production constraints
  • Build infrastructure for experimentation, model comparison, regression testing, and behavior analysis
  • Partner with AI Researchers to explore new post-training methods and with AI Engineers to apply successful techniques
  • Analyze model outputs, failure modes, human feedback, and production traces
  • Create repeatable processes for adapting AI systems to customer domains
  • Communicate clearly with internal teams and customer stakeholders about model behavior, evaluation results, limitations, and tradeoffs

Required qualifications

  • Experience with fine-tuning, preference optimization, reinforcement learning, reward modeling, synthetic data, evals, or related post-training techniques
  • Ability to build training and evaluation pipelines, run controlled experiments, analyze results, and iterate quickly
  • Understanding of how model behavior is shaped by data, prompts, tools, retrieval, evaluators, and deployment context
  • Use of AI tools daily to accelerate coding, analysis, debugging, experimentation, and research exploration
  • Ability to make behavioral improvements concrete through evaluations, comparisons, regression tests, and production-relevant metrics
  • Ability to balance research ambition with practical constraints around cost, latency, reliability, data availability, and customer requirements

Benefits

  • 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible time off
  • Retirement and financial planning benefits, including access to pre-tax HSA, FSA, and commuter accounts, 401(k), and financial coaching resources
  • Comprehensive wellness benefits, including physical fitness, mental well-being, and fertility and family-building benefits through Carrot
  • Complimentary in-office lunches and snacks provided
  • Access to state-of-the-art AI models, generous usage of modern AI tools, and real-world business problems
  • Ownership of high-impact projects across top enterprises

About the company

Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect critical operations for the frontier of AI. They research and deploy technologies that power AI-native operations.