Sr Software Development Engineer in Test, ML
Core
Lead quality efforts for machine learning-powered products and services by building scalable test automation and validation approaches for systems serving PlayStation at global scale.
Role type
Senior Software Development Engineer in Test (ML)
Builds
Automated test frameworks, test scripts for ML inference services, and validation datasets for probabilistic systems.
Domain
Gaming / Machine Learning / Quality Assurance
Deliverable
production ML models
Required skills
Python, Java, API testing, CI/CD pipelines, automated test frameworks, cloud technologies, container technologies, monitoring tools, software development lifecycle
Preferred skills
Testing machine learning systems, creating synthetic test data, statistical techniques for model evaluation, data pipelines, performance and load testing tools
Technologies
Python, Java, Postman, Jenkins, GitHub Actions, ArgoCD, pytest, JUnit, TestNG, AWS, GCP, Kubernetes, Docker, Prometheus, Grafana, Datadog, Locust, k6, Gatling, JMeter, Databricks, Seldon, KServe, Ray Serve
Responsibilities
Design and maintain automated test frameworks for ML inference services; Build and automate realistic test account creations and datasets; Validate score distributions, ranking behavior, and output quality for incoming ML models; Perform functional, integration, regression, API, and non-functional performance testing; Work with ML engineers to ensure automated test coverage for features and bug fixes; Debug and analyze test failures and model anomalies; Develop best practices for scalable and maintainable test automation.
Seniority
Senior, hands-on IC