Senior Software Engineer in Test - Agentic AI

The role

The Software Development Engineer in Test builds and executes automated tests for the TraceLink platform and application. This role involves building testing tools, executing performance tests, and working with engineers to ensure product testability.

What you will do

• Build and execute tests on the Tracelink platform and application.
• Build and deploy services for automated testing of the TraceLink platform persistent store.
• Execute performance tests on a Distributed Persistent Data store.
• Create testing tools that can simulate real-world transaction volumes.
• Provide high-level analysis to apply appropriate technologies and architecture to solve conceptual problems.
• Stay curious, build Innovative solution to new age technical issues.
• Influence designs and decision with supporting data.
• Work closely with engineers building the core Tracelink product to ensure that testability concerns are factored into the design of the product.
• Extend and maintain automation frameworks to enhance Test coverage.
• Prepare and present clear reports on defect findings.

Required qualifications

• Bachelor's degree or foreign equivalent in computer science, software engineering, mechanical engineering, or related discipline.
• 5-8 years of progressive, post-baccalaureate experience in a test automation engineering role involving programmatic interaction with a system under test.
• Experience utilizing Java, JavaScript/TypeScript, Eclipse, Ant or Maven, Unix, and an automated unit test framework, such as TestNG.
• Experience developing against web services and Web-based APIs.
• Experience developing and executing formal test plans, data sets, and test configurations for assigned feature areas.

Nice to have

• Familiarity with the concepts involved in running cloud-based applications on platforms such as Amazon Web Services.
• Experience with the pharmaceutical industry.
• Basic understanding of Large Language Models (LLMs) and generative AI systems.
• Exposure to testing LLM-based applications, including prompt validation and response evaluation.
• Familiarity with multi-agent LLM workflows and coordination patterns (e.g., agent orchestration, tool usage, chaining).
• Experience designing test scenarios for AI systems, including edge cases, hallucination detection, and output consistency checks.
• Knowledge of evaluation metrics for LLM outputs (e.g., accuracy, relevance, latency, and robustness).
• Exposure to automation frameworks or tools for validating AI/ML model behavior.

About the company

TraceLink is the world’s largest Agentic Business Network, enabling life sciences and healthcare companies to build and manage a scalable digital workforce. Founded in 2009, it has 5 global offices and over 800 employees.