Assured
Staff Software Development Engineer in Test (SDET)
Remote. Posted 6 months ago
The role
You will build automated testing and evaluation systems for traditional software and AI-powered products. You will work within a product engineering pod alongside engineers and product partners using TypeScript.
What you will do
- Build evaluation frameworks for LLM and agentic applications.
- Develop scalable TypeScript frameworks for UI, API, end-to-end, and integration testing.
- Integrate test suites into CI/CD pipelines.
- Investigate failures and reduce flaky tests.
- Create and maintain automation to improve coverage and catch regressions.
- Introduce approaches for evaluating nondeterministic behavior and AI workflows.
- Partner with engineering, product, SRE, and data science to define expectations.
Required qualifications
- Strong TypeScript fundamentals.
- Experience building production-quality automation within the TypeScript and JavaScript ecosystem.
- Experience as an SDET, QA Automation Engineer, or software engineer with significant responsibility for automated testing.
- Experience with tools such as Playwright, Jest, Axios, and CI/CD platforms like GitLab CI/CD or CircleCI.
- Interest in automated statistical QA, LLM-as-a-judge, trace evaluation, human annotations, and testing nondeterministic systems.
- Ability to communicate clearly and work well with engineering, product, SRE, and other cross-functional partners.
Nice to have
- Experience with Langfuse, Braintrust, Arize, Inngest, or similar platforms
Benefits
- Competitive salary and equity packages
- Platinum medical, dental, and vision
- Free life insurance including long-term disability & short-term disability
- Unlimited PTO including uncapped vacation days & paid holidays
- Maternity & paternity leave
- 401(k) contribution of 3% of income
- Lunch 2x/week
- Monthly phone stipend & other home office perks
- Health FSAs & HSAs
- Team events & Offsites
About the company
Assured provides large insurers with software solutions to modernize claims processing. They provide tools ranging from self-service claim-filing software to backend fraud detection.