Software Engineer in Test, Python
Core
Design and implement intelligent test analysis systems using AI and advanced analytics to identify quality gaps, predict failure patterns, and optimize test effectiveness for Roku's streaming media platform.
Role type
Senior SDET specializing in AI-driven test architecture and automation
Builds
Intelligent testing solutions, automated failure analysis systems, and predictive quality assurance frameworks
Domain
Streaming media / AI-powered Quality Assurance
Deliverable
production ML models | infrastructure
Required skills
Python, AI/LLM integration for testing, autonomous testing agents, test architecture design, continuous integration optimization, test flakiness analysis, root cause identification, regression tracking
Preferred skills
C++, AI/ML certifications, agentic engineering toolchain experience (Claude Code, Cursor, MCP servers)
Technologies
Python, Jenkins, GitLab, TeamCity, AWS, LLMs, agentic AI frameworks
Responsibilities
Design systems to collect and analyze testing data for continuous quality improvement; Establish methodologies for measuring test quality beyond pass/fail metrics; Leverage AI tools for automated failure analysis and test flakiness scoring; Architect patterns for effective, maintainable testing aligned with business impact; Implement systematic regression tracking to prevent reoccurrence; Optimize CI/CD pipelines for quality gates
Seniority
Senior, hands-on IC
