Staff ML Engineer, Frontier AI

The role

You will set the technical direction for AI systems that power clinical products. You will lead the design and execution of initiatives to improve model behavior, evaluation, post-training, and agentic systems.

What you will do

• Define the AI Quality and Evaluation Strategy
• Drive Production Model Improvement
• Advance Post-Training Capabilities
• Architect Agentic AI Systems
• Build Self-Improving AI Loops
• Shape the AI Roadmap
• Raise the Technical Bar
• Stay at the Cutting Edge

Required qualifications

• 7+ years in production ML, research engineering, or applied AI
• Deep expertise with modern LLMs, transformers, and complex production AI systems
• Experience designing evaluations for LLMs, agents, or other complex AI systems
• Experience with grader bias, leakage, contamination, misleading aggregate metrics, regression detection, and offline-online mismatch
• Experience building or architecting production systems involving multiple models, tools, retrieval, context and state management, routing, orchestration, tracing, and failure recovery
• Experience improving model behavior through post-training or model adaptation techniques
• Proficient in Python and modern ML frameworks
• Comfortable with modern MLOps, CI/CD, observability, and containerized deployments
• Skilled at building large, high-quality datasets and feedback loops

Nice to have

• Experience with realtime voice, conversational AI, or multimodal systems
• Prior work in healthcare, clinical AI, or other regulated, high-stakes industries
• Experience interviewing or hiring ML engineers
• Open-source contributions to ML, agent, evaluation, or post-training tooling
• PyTorch preferred

Benefits

• Comprehensive medical, dental, and vision coverage for you and your dependents
• 401(k) with a company match of up to 3% of base salary
• Full equipment provisioning
• Parental leave
• Annual company-wide off-sites, team off-sites and regular team lunches and all-hands gatherings with travel, lodging and meals covered
• Flexible time off with no annual cap
• Company-wide holidays
• Annual holiday shutdown from December 24–January 1

About the company

Ambience is building an AI intelligence platform that restores humanity to healthcare and drives meaningful ROI for health systems. The company provides real-time coding-aware documentation and clinical workflow support across North America.