Senior Software Development Engineer in Test, ML

The role

You will lead quality efforts for machine learning-powered products and services. You will build scalable test automation and validation approaches for systems serving PlayStation at global scale.

What you will do

• Drive architecture-level automation solutions and scalable quality engineering practices.
• Design, develop, and maintain automated test frameworks and test scripts using python/Java.
• Build and automate realistic test account creations and datasets.
• Validate score distributions, ranking behavior, and output quality for incoming ML models.
• Perform functional, integration, regression, API, and non-functional performance and load testing.
• Work with ML engineers and ops teams to ensure automated test coverage for continuous integration and deployment.
• Debug and analyze test failures and model anomalies.
• Drive high standards of quality for engineering decisions and customer-facing features.
• Develop and implement scalable and maintainable test automation best practices.
• Monitor test execution and optimize performance in test environments.

Required qualifications

• Bachelor's degree in Computer Science or related field
• Minimum 5 years of experience as an SDET, with strong experience testing backend systems
• Proficiency in Python/Java/Scala/go for test automation
• Hands-on experience with API testing tools (e.g., Postman or similar) for distributed systems
• Familiarity with CI/CD pipelines and test execution in Jenkins or similar environments such as jenkins, GitHub Actions, ArgoCD, etc
• Hands-on experience building and maintaining automated test frameworks (e.g., pytest, JUnit, TestNG, etc.)
• Experience in working with databases for backend validation
• Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker, etc.)
• Familiarity with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog, etc.) for validating service health
• Strong understanding of software development lifecycle (SDLC) and agile methodologies
• Excellent problem-solving skills
• Excellent communication skills

Nice to have

• Experience testing machine learning systems, such as recommendation systems, search ranking systems, or other probabilistic ML application systems
• Experience creating synthetic or seeded test data to simulate realistic customer/account behaviors
• Experience evaluating model outputs using statistical techniques, distribution analysis, or scenario-based validation
• Knowledge of data pipelines, feature stores, inference systems or model-serving infrastructure (Seldon, KServe, Ray Serve, etc.)
• Experience with performance and load testing tools
• Experience with Databricks or similar ML platform tooling
• Experience architecting and optimizing CI/CD pipelines, quality gates, and release validation systems using Jenkins or similar platforms

Benefits

• medical
• dental
• vision
• matching 401(k)
• paid time off
• wellness program
• employee discounts for Sony products
• may be eligible for a bonus package

Before you apply

• Sony Interactive Entertainment conducts background checks at the offer stage for all new employees

About the company

Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. It is a dynamic technology company and an entertainment leader.