Standinsurance
Member of the Technical Staff - Agentic Engineer
San Francisco, Remote. Posted 3 months ago
The role
You will build the runtime, contracts, and evaluation framework that enables the team to build and manage hundreds of agentic capabilities. This role involves creating an evaluation framework, a tooling center, an agent deployment pipeline, and an engineer/agent builder experience.
What you will do
- Define and implement the skill-and-eval contract for a real vertical.
- Build an opinionated platform for agent deployment and lifecycle management.
- Develop a high-throughput orchestration engine to manage agents and evaluations at scale.
- Coordinate complex, multi-agent workflows.
- Manage dependencies and automate fleet-wide health monitoring.
- Ensure consistent performance across the agentic ecosystem.
Required qualifications
- Proven experience shipping agentic systems into production environments where reliability is critical.
- Demonstrated track record of building tools or frameworks for engineering teams.
- Proficiency in designing and managing evaluation frameworks.
- Hands-on experience building Model Context Protocol (MCP) implementations.
- Experience managing prompts and skills in production environments.
- Familiarity with authorization frameworks and best practices.
- Comfort and experience in product discovery.
- Authorized to work in the U.S.
- Must be able to discuss how you use AI, how you evaluate its output, and how it informs your work.
Nice to have
- Experience in insurance or another regulated operational domain.
- Learning from logged human decisions: Transform unstructured operator event data into preference datasets for fine-tuning and reward modeling.
- Built internal tooling for agentic software development.
- Enough frontend range (React/Next.js) to prototype the queue surface a skill feeds.
- Contributions to open-source agent frameworks, eval tooling, or MCP servers.
- Experience partnering with an applied-science or research team and shipping their work into a product loop.
Benefits
- Above-market Health, Dental, and Vision coverage
- Weekly lunch stipend
- Flexible time off + holidays
- 401(k) plan
- Commuter benefits
- PAT & MAT Leave
- Short-Term and Long-Term Disability
- Monthly team gatherings
- In-office perks
Before you apply
- Stand does not sponsor new work visas.
- Can consider candidates on TN visas, O-1A visas, or H-1B transfers with three years or more remaining.
- If you plan to use an AI assistant or LLM during any portion of an interview, please discuss it with your interviewer in advance.
About the company
Stand uses advanced physics and AI to model catastrophic risk at the asset level to automate underwriting and mitigation. The company is building a scalable risk engine called the Stand World Model.