Senior Software Development Engineer in Test, ML

The role

You will lead quality efforts for machine learning-powered products and services. You will build scalable test automation and validation approaches for systems serving PlayStation at global scale.

What you will do

• Drive architecture-level automation solutions and scalable quality engineering practices
• Design, develop, and maintain automated test frameworks and scripts using python/Java
• Build and automate realistic test account creations and datasets
• Validate score distributions, ranking behavior, and output quality for ML models
• Perform functional, integration, regression, API, and non-functional performance and load testing
• Work with ML engineers and ops teams to ensure automated test coverage for CI/CD
• Debug and analyze test failures and model anomalies
• Drive high standards of quality for engineering decisions and customer-facing features
• Develop and implement scalable and maintainable test automation best practices
• Monitor test execution and optimize performance in test environments

Required qualifications

• Bachelor's degree in Computer Science or related field
• Minimum 5 years of experience as an SDET, with strong experience testing backend systems
• Proficiency in Python/Java/Scala/go for test automation
• Hands-on experience with API testing tools (e.g., Postman or similar) for distributed systems
• Familiarity with CI/CD pipelines and test execution in Jenkins or similar environments such as jenkins, GitHub Actions, ArgoCD, etc
• Hands-on experience building and maintaining automated test frameworks (e.g., pytest, JUnit, TestNG, etc.)
• Experience in working with databases for backend validation
• Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker, etc.)
• Familiarity with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog, etc.) for validating service health
• Strong understanding of software development lifecycle (SDLC) and agile methodologies
• Excellent problem-solving skills
• Excellent communication skills

Nice to have

• Experience testing machine learning systems, such as recommendation systems, search ranking systems, or other probabilistic ML application systems
• Experience creating synthetic or seeded test data to simulate realistic customer/account behaviors
• Experience evaluating model outputs using statistical techniques, distribution analysis, or scenario-based validation
• Knowledge of data pipelines, feature stores, inference systems or model-serving infrastructure (Seldon, KServe, Ray Serve, etc.)
• Experience with performance and load testing tools
• Experience with Databricks or similar ML platform tooling
• Experience architecting and optimizing CI/CD pipelines, quality gates, and release validation systems using Jenkins or similar platforms

Before you apply

• Sony Interactive Entertainment conducts background checks at the offer stage for all new employees

About the company

Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. It is a dynamic technology company and an entertainment leader.