ML Engineer, Retrieval & Grounded Generation

The role

You will own quality for an AI-enabled decision-support system by creating test plans, automated coverage, and evidence of specification compliance. You will build automated test suites, manage release governance, and hold engineering and platform teams accountable to acceptance criteria.

What you will do

• Own the system test plan covering functional, integration, performance, and load testing
• Translate acceptance criteria set by product into executable tests
• Review acceptance criteria with product and identify ambiguous requirements
• Hold engineering, platform, and partner teams accountable to acceptance criteria
• Plan and coordinate user acceptance testing with the customer
• Build and maintain automated test suites and integrate them into the CI/CD pipeline
• Establish and hold an automated coverage standard
• Build performance and load testing
• Build and maintain labeled evaluation sets
• Design and run sampled audits confirming automated decisions were correct

Required qualifications

• 5+ years in software quality engineering, test automation, or software engineering with substantial dedicated test ownership
• Strong coding ability in a language and framework used for test automation, such as Python with pytest, or JavaScript or TypeScript with Playwright, Cypress, or Selenium
• Routine use of AI-assisted development
• Demonstrated experience building automated test suites and integrating them into CI/CD as release gates
• Experience owning a test plan through review and acceptance
• Demonstrated habit of testing against the requirement rather than the implementation
• Experience with performance and load testing
• Working statistical literacy, including sampling design and the confidence a measurement can support
• Experience measuring what a system misses
• Ability to gate work owned by people who do not report to you
• Clear, audit-ready written documentation
• US Citizenship Required

Nice to have

• active Top Secret clearance
• experience in government DevSecOps, RMF, or ATO environments
• experience producing test evidence for a formal accreditation or audit
• contract and API testing
• test data management
• building test infrastructure others can extend
• using language models to generate and maintain test coverage
• JMeter, k6, Locust, or comparable
• validating machine learning or model output, including groundedness and citation checking
• systems where an incorrect result carries real cost

Benefits

• fully remote, results-based environment
• Competitive salary, bonus, and equity package
• 100% employer paid, comprehensive health insurance including medical, dental, and vision for you and your family
• Unlimited PTO, with your manager’s approval
• Flexible work environment where you manage your work day
• 14 weeks of fully-paid parental leave
• Career track opportunity with potential for rapid advancement
• Opportunities for professional development and continued learning
• Optional 401K, FSA, and equity incentives available
• Mental health benefits are available through Tara Mind
• Cost effective GLP-1 solutions available through Crux

Before you apply

• US Citizenship Required
• Active US Secret clearance required
• Requires a favorable investigation and CAC eligibility from the start
• Elevated security requirements apply to portions of this work

About the company

Red Cell Partners is an incubation firm building and investing in rapidly scalable technology-led companies in healthcare, cyber, and national security. DEFCON AI is an insights company that leverages artificial intelligence, mathematical optimization, data analytics, and software engineering.