Senior Staff Applied AI Engineer

The role

This person will be a technical leader for AI at OpenLoop. They will set technical direction for agent runtime, build evaluation systems, manage model access, and design workflows to turn human processes into agent workflows.

What you will do

• Set technical direction for agent runtime and orchestration
• Build systems to prove AI quality including regression tests and AI-graded evals
• Set up access to models from multiple providers and manage version upgrades
• Trace agent actions and monitor behavior in production
• Attribute AI spend to each agent and use case
• Connect agents to company data through retrieval, context design and prompt engineering
• Partner with operations teams to turn human workflows into agent workflows
• Protect patient data and defend against misuse such as prompt injection
• Make infrastructure decisions on GCP
• Mentor engineers through code and design review

Required qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical field
• 12+ years of software engineering experience, with a track record at tech lead, staff or principal-level scope
• 2+ years building and running LLM-based systems in production
• Deep, hands-on expertise in agent runtime or evaluation, a second area of real depth, and working knowledge across the rest of the AI engineering stack
• Track record of measuring AI quality with real evaluation sets and test harnesses
• Experience leading a small team's technical direction from zero in a greenfield setting
• Excellent communication skills with the ability to explain complex technical concepts and trade-offs to non-technical stakeholders

Nice to have

• Regulated-Industry Experience: Healthcare (PHI, HIPAA), finance or insurance
• GCP Experience: Running production services on Google Cloud
• Internal Platforms: Built a platform used by other engineering teams
• Team Scaling: Helped grow a single pod into multiple teams

Benefits

• Medical, Dental, and Vision plans
• Flexible Spending/Health Savings Accounts
• Flexible PTO
• 401(k) + Company Match
• Life Insurance, Pet insurance, and more

About the company

OpenLoop provides telehealth support solutions designed to streamline care delivery for companies offering virtual support to patients across 50 states. The company has a relatively flat organizational structure with core values of Autonomy, Competence and Belonging.