Software Development Test Engineer (SDET)
Core
Design and maintain automated testing frameworks, validation strategies, and quality gates for AI-powered applications, LLMs, and backend services.
Role type
Senior SDET specializing in AI/ML and LLM testing
Builds
Automated testing frameworks, test harnesses, and evaluation workflows for AI models and agents
Domain
Artificial Intelligence / Machine Learning / Software Quality Engineering
Deliverable
production ML models
Required skills
Python, Java, JavaScript/TypeScript, Rust, automated test framework design, CI/CD integration, API testing, test management, Git workflows
Preferred skills
LLMs, agentic systems, retrieval-augmented generation, tool calling, prompt-driven workflows, model evaluation, benchmarking, adversarial testing, Docker, Kubernetes, cloud testing, cybersecurity
Technologies
GitHub Actions, Jenkins, GitLab CI, Postman, REST Assured, TestRail, Docker, Kubernetes
Responsibilities
Define test strategies and acceptance criteria for AI applications; Develop deterministic and probabilistic validation strategies for LLM functionality; Build automated regression, integration, and end-to-end tests; Integrate validation gates into CI/CD pipelines; Analyze model failures and telemetry to identify root causes; Contribute to AI testing methodologies and automation practices.
Seniority
Senior, hands-on IC
