SDET 3
Core
Senior SDET defining testing methodologies, building automated evaluations, and establishing quality criteria for GenAI solutions (chatbots, voice IVR, AI agents) and customer-facing products.
Role type
Senior SDET (GenAI & Quality Engineering)
Builds
Automated evaluation suites, UI/API regression test suites, and quality frameworks for GenAI agents.
Domain
Generative AI, Customer Experience (CX), Software Quality Assurance
Deliverable
production ML models
Required skills
Python, Java, UI automation (Selenium/Playwright), API automation, CI/CD integration, LLM-as-judge evaluation, AI agent testing, LangChain/LangGraph/LangSmith, test strategy design, code review
Preferred skills
GenAI agent testing, RAG testing, AI observability tools
Technologies
Python, Java, Selenium, Playwright, REST API, Postman, TestNG, PyTest, LangChain, LangGraph, LangSmith, GitHub Actions, Jenkins, AWS
Responsibilities
Own test strategy and release quality criteria; Build and maintain UI, API, and end-to-end automation; Design evaluation strategies for AI agents using LLM-as-judge; Create evaluation datasets and suites integrated with CI/CD; Test AI agents for accuracy, consistency, safety, and data handling; Debug agent failures using observability tools; Analyze quality across releases; Mentor other SDETs.
Seniority
Senior, hands-on IC