SDET Contractor

The role

This person will design and implement automated testing strategies for Agentic AI systems, backend services, APIs, and distributed systems. They will validate AI-generated responses and test AI guardrails, workflows, and service integrations.

What you will do

• Develop and execute QE strategies and test plans for Agentic AI systems and backend services.
• Design and maintain scalable automated test frameworks.
• Develop testing approaches for non-deterministic AI behavior.
• Integrate automated testing into CI/CD pipelines.
• Partner with Software Engineers and Product Managers to improve product quality.
• Analyze defects and production issues to identify root causes.
• Establish quality metrics and visibility into test coverage.
• Test Agentic AI workflows including multi-step execution and tool selection.
• Validate AI-generated responses for accuracy, relevance, and consistency.
• Test AI guardrails, unexpected inputs, and failure scenarios.

Required qualifications

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
• 4+ years of experience in Software Development Engineering in Test, Quality Engineering, Software Engineering, or a related discipline.
• Strong experience testing REST APIs, backend services, microservices, or distributed systems.
• Hands-on experience developing automated tests using Python, Java, JavaScript, TypeScript, or a similar programming language.
• Experience with functional, integration, regression, contract, and end-to-end testing.
• Experience integrating automated tests into CI/CD pipelines.
• Strong analytical, debugging, and root-cause-analysis skills.
• Experience working in an Agile development environment.
• Strong understanding of software testing methodologies and Quality Engineering practices.
• Strong API and services testing experience, including REST, JSON, schemas, authentication, and error handling.
• Experience designing and maintaining automated test frameworks.
• Experience with Git and CI/CD development workflows.

Nice to have

• Experience testing Agentic AI workflows, including planning, multi-step execution, tool calling, memory, or state management.
• Experience with AI evaluation techniques such as evaluation datasets, semantic evaluation, LLM-as-a-Judge, groundedness, relevance, or hallucination detection.
• Experience with AI/LLM evaluation or observability tools such as LangSmith, DeepEval, Ragas, Arize Phoenix, Promptfoo, or similar technologies.
• Experience testing RAG systems or AI agents interacting with APIs, databases, or external tools.
• Experience with contract testing tools such as Pact and API specifications such as OpenAPI/Swagger.
• Experience with event-driven architectures, Kafka, Docker, Kubernetes, or cloud platforms such as AWS.
• Experience with performance, scalability, reliability, or resiliency testing.
• Experience establishing QE metrics, quality gates, or cross-team testing standards.

Benefits

• medical
• dental
• vision

Before you apply

• Sony Interactive Entertainment conducts background checks at the offer stage for all new employees.

About the company

Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. It is a dynamic technology company and an entertainment leader.