Staff AI Engineer | Agentic Systems

The role

A Staff AI Engineer will set the technical direction and own the architecture for agentic systems that audit medical claims. This hands-on role involves designing agent loops, setting evaluation strategies, and engineering context at scale for production LLM workloads.

What you will do

• Own the agent architecture including loops, tools, context strategy, and evaluation harness.
• Set the evaluation strategy and build evaluation infrastructure.
• Engineer context at scale for long, noisy medical records.
• Lead projects that span several engineers and quarters.
• Make decisions on model choice, build versus buy, and trade-offs between cost, latency, and accuracy.
• Run LLM workloads in production with focus on reliability, observability, and cost control.
• Mentor engineers, review designs and code, and set team standards.
• Become a domain expert in healthcare claims, coding guidelines, and medical records.

Required qualifications

• 8+ years of software or ML engineering experience
• 3+ years building applied ML / AI systems in production
• Bachelor's in CS, Math, Engineering or a related quantitative field
• Staff-level technical leadership setting architecture for production systems
• Hands-on generative AI experience training or fine-tuning models or building agentic systems
• Deep, hands-on understanding of agent loops
• Hands-on experience with at least one major agent SDK (OpenAI Agents SDK, Anthropic SDK / claude-agent-sdk, LangGraph, or equivalent)
• Working knowledge of how modern coding agents are built
• Fluency with Claude Code / Codex as a power user
• Strong Python engineering including clean abstractions, type discipline, async, and tested code
• Solid command of VS Code and git

Nice to have

• Master's or PhD
• Prior work on long-context, citation-grounded systems
• Production experience with caching, observability, and cost and latency control on LLM workloads at scale
• Experience designing structured outputs and tool interfaces that LLMs reliably call correctly
• Familiarity with reasoning models
• Healthcare, legal, finance, or any other domain where "mostly right" is unacceptable
• Document understanding (OCR, layout-aware models, table extraction)
• Vision-language models, multimodal retrieval
• Published work or substantial open-source contributions on agents, evals or LLM systems

Benefits

• Top Medical/Dental/Vision offerings
• FSA/HSA
• Tuition reimbursement
• Competitive salary
• 401(k) with company match
• Unlimited PTO
• Additional health and wellness benefits and perks

About the company

Machinify is a healthcare intelligence company that delivers an AI-powered platform to health plan clients. It is deployed by over 85 health plans, representing more than 270 million lives.