Senior Software Engineer, AI Developer Experience

The role

You will build systems, infrastructure, and developer workflows to make AI-powered engineering more useful and reliable for Vanta engineers. The role involves developing background-agent infrastructure, evaluation systems, and tooling to support an autonomous software development experience.

What you will do

• Plan, build, and improve background-agent infrastructure.
• Develop systems for evaluating agent performance.
• Create evaluation sets and feedback loops for AI systems.
• Improve how engineers discover and use shared AI tools and workflows.
• Evaluate AI development tools against real engineering needs.
• Develop visibility into tool usefulness and friction.
• Create clear guidance and documentation for AI-enabled development practices.
• Improve code review workflows using feedback from engineering work.
• Influence the foundations of an autonomous software factory.
• Work with engineers and internal users to validate solutions and make product tradeoffs.

Required qualifications

• Substantial industry software engineering experience.
• Experience taking technical leadership roles on teams or complex projects.
• Experience improving AI systems, creating evaluation sets, and driving quality hill-climbing through measurement and iteration.
• Strong software engineering fundamentals and experience designing, building, testing, and operating reliable systems.
• Experience with developer tooling, AI-enabled workflows, agentic systems, infrastructure, or related technical domains.
• A track record of working through ambiguity, decomposing complex problems, managing dependencies, and helping projects reach completion.
• Experience working in rapidly scaling startups or larger companies, particularly in environments with a strong bias for action.
• An action-oriented approach and a willingness to engage directly with users and contribute hands-on.
• Product judgment and curiosity.
• Strong written and verbal communication.
• A collaborative approach and a demonstrated ability to make meaningful contributions as part of a team.
• Uses AI in day-to-day work to amplify skills and strengthen outcomes.

Benefits

• Industry-competitive salary and equity
• Comprehensive medical, dental, and vision coverage, with 100% of employee-only benefit premiums covered for most medical plans
• 16 weeks paid Parental Leave for all new parents
• Health & wellness stipend
• Remote workspace, internet, and cellphone stipend
• Commuter benefits for team members who report to the SF and NYC office
• Family planning benefits
• Matching 401(k) contribution with immediate vesting
• Flexible PTO policy, plus 80 hours of Sick Time
• 11 company-paid holidays
• Virtual team building activities, lunch and learns, and other company-wide events!

About the company

Vanta helps businesses earn and prove trust by enabling continuous security monitoring and verification. The company provides a Trust Management Platform to help companies improve and prove their security.