Software Engineer, Agents (Internal Audit)

The role

You will build and ship LLM-backed agent features for internal audit work. You will own agent quality, manage tradeoffs between quality, latency, and cost, and work with subject matter experts to turn feedback into agent changes.

What you will do

• Run error analysis on real testing data and turn findings into concrete fixes
• Manage tradeoffs such as quality, latency, and cost across multi-phase runs
• Build structured-output pipelines to turn model output into audit artifacts
• Turn ambiguous problem statements into plans and shipped features
• Work with embedded subject matter experts and design-partner firms to implement feedback
• Expand agent coverage into new controls and areas of internal audit

Required qualifications

• Shipped LLM-backed product features to production against real users
• Applied AI skillset including evals, error analysis, and model-selection decisions
• Full-stack capability with backend depth for agent orchestration
• Ability to work autonomously from an ambiguous spec
• Collaborative mode working across PM, design, and domain experts

Nice to have

• Python, TypeScript, React, Postgres, Hasura, GraphQL
• Temporal or comparable durable-execution / workflow orchestration
• Hands-on eval experience (Langfuse, Braintrust, LangSmith, Arize Phoenix, or comparable)
• Structured-output work including schema contracts
• Startup experience as a founder or early engineer
• A 0→1 track record
• Experience working directly with customers
• Background in internal audit, SOX, accounting, or another regulated domain
• Document processing, including PDF and Excel manipulation and annotation

Benefits

• Competitive compensation with equity
• Comprehensive health and wellness benefits
• Flexible time off and work schedules
• Technology reimbursements
• 401(k) plan
• Twice-yearly in-person offsites across the U.S.
• Wellness benefits starting on your first day

About the company

Fieldguide builds software to automate and streamline the work of assurance and audit practitioners in cybersecurity, privacy, and financial audits. The company is based in San Francisco, CA.