Openloophealth
Senior Engineering Manager, AI Platform
United States - Remote. Posted 11 days ago
The role
You will build and lead the Applied AI team to ship LLM-based agents and assistants. You will own the delivery of production AI systems and set standards for building, evaluating, and safely running AI on patient data.
What you will do
- Hire, onboard and develop a team of Applied AI Engineers.
- Drive the roadmap and execution of LLM-based agents and assistants.
- Partner with Staff+ engineers on architecture for agent runtime and orchestration, retrieval, model access and observability.
- Make evaluation sets, regression tests and AI-graded evals a required part of how the team ships.
- Own the operational health of AI systems in production, including on-call, incident response, provider fallbacks, model version upgrades and AI spend.
- Ensure AI systems protect patient data and follow HIPAA requirements.
- Work with Product and Operations leaders to prioritize workflows and use cases.
- Explain AI capabilities, risks and timelines to stakeholders.
- Run planning, prioritization and delivery rituals.
- Other duties as assigned.
Required qualifications
- Bachelor's degree in Computer Science, Engineering, or a related technical field
- 10+ years of software engineering experience
- 3+ years managing engineers directly (hiring, performance management, career development)
- Led or built LLM-based systems in production that real users relied on
- Experience managing senior and Staff-level engineers
- Hands-on understanding of agent runtime, evaluation, retrieval and observability
- Strong grounding in production engineering across testing, services, APIs, deployment, incident management and on-call
- Experience leading teams that handle sensitive data with a security-first mindset
- Comfort building in a greenfield space
- Clear communication with technical and non-technical partners
Nice to have
- Healthcare (PHI, HIPAA), finance or insurance experience
- GCP Experience: Leading teams that run production services on Google Cloud
- Grew an engineering team from zero, or from one team to several
- Led migrations between model versions or providers
- Machine learning experience beyond LLMs
- Led a platform used by other engineering teams
Benefits
- Medical, Dental, and Vision plans
- Flexible Spending/Health Savings Accounts
- Flexible PTO
- 401(k) + Company Match
- Life Insurance
- Pet insurance
About the company
OpenLoop provides telehealth support solutions designed to streamline care delivery for companies offering virtual support to patients across all 50 states. The company has a relatively flat organizational structure with core values of Autonomy, Competence and Belonging.