Senior Test Automation Engineer

The role

You will own the test automation strategy for a product domain. You will design scalable automation frameworks, manage release risk, and test AI systems and radiologist workflows.

What you will do

• Own test automation strategy for your domain
• Design scalable and maintainable automation frameworks, fixtures, and utilities
• Run pre-release risk assessments and lead test planning
• Turn radiologist personas and real workflows into test cases
• Drive down flaky and low-signal tests
• Lead performance, load, security, accessibility, and compliance testing
• Design evaluations for non-deterministic AI outputs
• Use incident reviews to add regression coverage
• Track escaped defects, test stability, and time to detect
• Mentor TAEs and software engineers

Required qualifications

• 6+ years of software engineering or test automation experience
• 3+ years designing and owning automation frameworks
• Strong programming skills in TypeScript and/or Python
• Deep experience with end-to-end frameworks such as Playwright, Selenium, or Cypress
• API testing experience across REST and GraphQL services
• Experience building tests into CI/CD pipelines such as GitHub Actions or CircleCI
• Track record of reducing flakiness and suite runtime
• Experience with risk-based test strategy for integration-heavy systems
• Strong debugging skills with working knowledge of SQL, logs, and observability tools
• Shift-left mindset
• Hands-on use of AI tools to write, maintain, and triage tests
• Detail-oriented, collaborative, and able to influence without authority

Nice to have

• Worked in healthcare or another regulated environment (HIPAA, PHI, SOC 2)
• Familiar with radiology systems: PACS, RIS, dictation platforms, HL7/FHIR, FHIRcast, or DICOM
• Automated Windows desktop or Electron applications
• Tested ML, AI, or speech systems
• Owned performance or load testing, or integrated security checks into pipelines
• Worked with AWS or Google Cloud, and provisioned test environments with tools like Docker or Terraform
• Used a test case management system such as Testmo, or built quality dashboards in tools like Grafana
• Experience with an object-oriented language such as C# or Java

Benefits

• Comprehensive Medical, Dental, Vision & Life insurance
• HSA (with employer match), FSA, & DCFSA
• 401(k)
• 11 Paid Company Holidays
• Flexible PTO policy
• Annual company-wide offsite
• Periodic team offsites
• Annual equipment stipend

About the company

Rad AI is on a mission to transform healthcare with artificial intelligence. Their AI-driven solutions are used by thousands of radiologists to improve patient care.