Software Development Test Engineer (SDET), AI & Automation
Core
Senior SDET partnering with AI engineers to build automated testing frameworks and validation strategies for non-deterministic AI/ML systems and traditional software.
Role type
Senior IC SDET (AI & Automation)
Builds
Automated testing frameworks, test harnesses, and CI/CD quality gates for AI-powered applications.
Domain
Cybersecurity / AI & Machine Learning
Deliverable
production ML models
Required skills
Python, Java, JavaScript/TypeScript, Rust, REST API testing, CI/CD pipeline integration, test framework design, probabilistic validation, synthetic data generation, defect analysis, Git workflows, AI-assisted development tools
Preferred skills
LLM testing, agentic systems, retrieval-augmented generation, Rust production experience, adversarial testing, Docker/Kubernetes, security-sensitive software testing
Technologies
Python, Java, JavaScript/TypeScript, Rust, GitHub Actions, Jenkins, GitLab CI, Postman, REST Assured, TestRail, Claude, ChatGPT, GitHub Copilot
Responsibilities
Design and maintain automated testing frameworks for AI-powered applications; Develop testing strategies for deterministic software and non-deterministic AI/ML outputs; Define measurable evaluation criteria and quality thresholds for AI models; Build automated regression, integration, API, and end-to-end coverage; Integrate automated validation into CI/CD pipelines; Analyze model failures and distinguish defects from expected variability.
Seniority
Senior, hands-on IC