Openloophealth

Senior Engineering Manager, AI Platform

United States - Remote. Posted 11 days ago

The role

You will build and lead the Applied AI team to ship LLM-based agents and assistants. You will own the delivery of production AI systems and set standards for building, evaluating, and safely running AI on patient data.

What you will do

  • Hire, onboard and develop a team of Applied AI Engineers.
  • Drive the roadmap and execution of LLM-based agents and assistants.
  • Partner with Staff+ engineers on architecture for agent runtime and orchestration, retrieval, model access and observability.
  • Make evaluation sets, regression tests and AI-graded evals a required part of how the team ships.
  • Own the operational health of AI systems in production, including on-call, incident response, provider fallbacks, model version upgrades and AI spend.
  • Ensure AI systems protect patient data and follow HIPAA requirements.
  • Work with Product and Operations leaders to prioritize workflows and use cases.
  • Explain AI capabilities, risks and timelines to stakeholders.
  • Run planning, prioritization and delivery rituals.
  • Other duties as assigned.

Required qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related technical field
  • 10+ years of software engineering experience
  • 3+ years managing engineers directly (hiring, performance management, career development)
  • Led or built LLM-based systems in production that real users relied on
  • Experience managing senior and Staff-level engineers
  • Hands-on understanding of agent runtime, evaluation, retrieval and observability
  • Strong grounding in production engineering across testing, services, APIs, deployment, incident management and on-call
  • Experience leading teams that handle sensitive data with a security-first mindset
  • Comfort building in a greenfield space
  • Clear communication with technical and non-technical partners

Nice to have

  • Healthcare (PHI, HIPAA), finance or insurance experience
  • GCP Experience: Leading teams that run production services on Google Cloud
  • Grew an engineering team from zero, or from one team to several
  • Led migrations between model versions or providers
  • Machine learning experience beyond LLMs
  • Led a platform used by other engineering teams

Benefits

  • Medical, Dental, and Vision plans
  • Flexible Spending/Health Savings Accounts
  • Flexible PTO
  • 401(k) + Company Match
  • Life Insurance
  • Pet insurance

About the company

OpenLoop provides telehealth support solutions designed to streamline care delivery for companies offering virtual support to patients across all 50 states. The company has a relatively flat organizational structure with core values of Autonomy, Competence and Belonging.

Senior Engineering Manager, AI Platform at Openloophealth | JobZoey