UAT Testing
Core
Design, develop, and maintain UI and API automation frameworks to validate AI-driven applications, agentic AI workflows, LLM-powered systems, and intelligent agents.
Role type
Senior QA Automation Engineer (AI/LLM focus)
Builds
Reusable automation frameworks, evaluation metrics for AI response quality, and integrated CI/CD test suites
Domain
Artificial Intelligence, Large Language Models (LLM), Agentic Workflows, Software Quality Assurance
Deliverable
production ML models | product features
Required skills
UI and API test automation, Playwright, TypeScript, AI model testing, agentic workflow validation, LLM evaluation, REST API testing, CI/CD integration, defect tracking, root cause analysis, mentoring
Preferred skills
None stated
Technologies
Playwright, TypeScript
Responsibilities
Design and execute test strategies for AI models, prompts, and autonomous agent behaviors; Develop evaluation frameworks measuring AI response quality, accuracy, reliability, and safety; Automate functional, regression, smoke, integration, and end-to-end test scenarios; Integrate automation suites into CI/CD pipelines; Mentor junior QA engineers and contribute to automation best practices
Seniority
Senior, hands-on IC
