Senior Engineer, Applied AI

The role

You will build and ship LLM-powered features across the patient experience, clinical operations and internal tooling. You will own AI features from prototype through production and work with clinical operators to improve their workflows.

What you will do

• Design, build and ship production LLM-powered features end-to-end.
• Build the AI application layer: prompt orchestration, tool calling, retrieval (RAG), embeddings, agent workflows and structured outputs.
• Develop evaluation infrastructure, including regression suites, LLM-as-a-judge evaluations, synthetic datasets and human review workflows.
• Design observability systems that measure accuracy, latency, cost, hallucination rates and model behavior in production.
• Build safety and reliability guardrails that meet quality, compliance and operational requirements.
• Evaluate and integrate third-party tools and model providers, and make build-versus-buy decisions.
• Raise engineering standards through technical leadership, code reviews, mentorship and system design.
• Sit with EHR operators, Patient Advocates and clinical teams to understand the workflows you are automating.
• Prototype quickly, ship early, measure outcomes and iterate based on real-world usage.

Required qualifications

• 5+ years building production software.
• At least 1–2 years building and deploying LLM-powered applications in production, or equivalent depth through substantial side projects or open-source work.
• Strong Python engineer with experience building backend services and integrating modern AI APIs and frameworks.
• Comfortable using AI-assisted development tools throughout the software development lifecycle.
• Has shipped AI features that served real users and can articulate how quality, reliability, latency, cost and business impact were measured.
• Strong product instincts; thrives in ambiguous environments and translates operational problems into technical solutions without detailed specifications.

Nice to have

• Experience with orchestration frameworks (LangChain, LangGraph, AgentCore).
• Experience with RAG architectures.
• Experience with vector databases.
• Experience with prompt and version management.
• Experience with evaluation or observability platforms (e.g., LangSmith, Braintrust, Arize Phoenix).

Benefits

• Competitive equity and benefits package (as applicable).

Before you apply

• Ro is committed to providing reasonable accommodations for qualified individuals with disabilities in the application and interview process; contact talent@ro.co to request one.

About the company

Ro is building a vertically integrated healthcare platform that connects telehealth, diagnostics, pharmacy and logistics for millions of patients. The company states it is consistently recognized as a top workplace in health care.