SDET 3
Core
Senior SDET owning quality for customer-facing web dashboards, APIs, notifications, and GenAI products (chatbots, voice IVR, AI agents) by defining test strategies, building automated evals, and setting release criteria.
Role type
Senior SDET (GenAI & Quality Engineering)
Builds
Automated test suites (UI, API, E2E), AI agent evaluation frameworks, and quality gates for release.
Domain
Energy utilities / Generative AI
Deliverable
production ML models
Required skills
Python, Java, UI automation (Selenium/Playwright), API automation, CI/CD integration, LLM evaluation (LLM-as-judge), AI agent testing, test strategy design, code review, mentoring
Preferred skills
LangChain, LangGraph, LangSmith, RAG testing, AI observability tools
Technologies
Python, Java, Selenium, Playwright, REST API, Postman, TestNG, PyTest, LangChain, LangGraph, LangSmith, GitHub Actions, Jenkins, AWS
Responsibilities
Define test strategy and release quality criteria; Build and maintain UI, API, and end-to-end regression suites; Design evaluation strategies for AI agents using LLM-as-judge; Build eval datasets and automated suites in Python; Test AI agents for accuracy, consistency, safety, and data handling; Debug agent failures using AI observability tools; Analyze release quality and identify regressions; Review requirements and test coverage; Mentor SDETs and set testing standards.
Seniority
Senior, hands-on IC