SDET - AI
Core
Senior SDET specializing in quality assurance for GenAI/Agentic systems, LLM-powered applications, and agentic workflows.
Role type
Senior IC SDET (GenAI)
Builds
Reliable, accurate, and trustworthy AI features and agentic workflows for Anaplan's scenario planning platform.
Domain
Enterprise SaaS / Generative AI / LLMs
Deliverable
production ML models | product features
Required skills
GenAI technologies (LLMs, prompt engineering), Python, test automation frameworks (Pytest, Selenium), API testing (Postman, REST Assured), CI/CD integration, adversarial testing (red-teaming), non-deterministic system testing
Preferred skills
None stated
Technologies
Python, JavaScript, Selenium, Pytest, Postman, REST Assured
Responsibilities
Design and architect test plans and evaluation frameworks for LLM applications; Develop end-to-end automated test suites (evaluations, API, UI, performance); Create automated prompt testing and regression suites; Establish multi-dimensional evaluation criteria for GenAI quality; Perform adversarial testing to identify hallucinations and biases; Develop internal tools for engineering teams to validate GenAI implementations; Deploy real-time monitoring and alerting for production quality degradation.
Seniority
Senior, hands-on IC
