Senior Software Development Engineer In Test, ML/AI
Core
Designing and implementing scalable automation frameworks and quality strategies for ML/AI-powered services, including LLM-assisted test generation and validation of AI outputs.
Role type
Senior SDET specializing in ML/AI quality assurance
Builds
Automated testing frameworks, validation pipelines for ML/LLM outputs, and CI/CD integration for AI features
Domain
Gaming / Machine Learning / AI Safety
Deliverable
production ML models | product features
Required skills
Python, Java, LLM usage for test generation, AI evaluation tooling, RESTful API testing, microservices testing, CI/CD pipelines, cloud/container technologies, automation frameworks (pytest, JUnit, Selenium, Playwright, Cypress, Appium)
Preferred skills
Statistical analysis for ML validation, ML infrastructure experience (Seldon, KServe, Ray Serve), adversarial ML testing, high-scale low-latency service testing, Databricks, Node.js, React, mobile/console platform testing
Technologies
Python, Java, JS, pytest, JUnit, Selenium, Playwright, Cypress, Appium, Jenkins, GitHub Actions, AWS, GCP, Kubernetes, Docker, Databricks, Seldon, KServe, Ray Serve
Responsibilities
Define quality strategies and test plans for ML-powered services; Use LLMs to generate and maintain test cases; Design scenario-based test suites for AI features including adversarial prompts; Lead QE efforts for multi-functional projects; Develop and maintain automation frameworks for backend services and ML inference systems; Build automated validation for ML and LLM outputs; Debug test failures and model inconsistencies; Perform functional, integration, regression, API, and performance testing; Integrate automated testing into CI/CD pipelines; Establish scalable quality standards and tooling
Seniority
Senior, hands-on IC