UAT Testing
Core
Design, develop, and maintain scalable UI and API automation frameworks for AI-driven applications, agentic AI workflows, and LLM-powered systems.
Role type
Senior UI/API Automation Engineer (AI/LLM focus)
Builds
Reusable automation components, evaluation frameworks for AI response quality, and integrated CI/CD test suites
Domain
Artificial Intelligence, Large Language Models, Agentic Workflows, Banking, Insurance, Payment Services, Energy
Deliverable
production ML models | product features | dashboards & analysis
Required skills
UI and API test automation, Playwright, TypeScript, agentic AI testing, LLM evaluation frameworks, REST API testing, CI/CD integration, defect tracking, root cause analysis, test strategy design
Preferred skills
Mentoring junior QA engineers, automation best practices
Technologies
Playwright, TypeScript, REST APIs, CI/CD pipelines
Responsibilities
Design and execute test strategies for AI models, prompts, and autonomous agent behaviors; Automate functional, regression, smoke, integration, and end-to-end test scenarios; Develop evaluation frameworks for AI response quality, accuracy, reliability, safety, and performance; Integrate automation suites into CI/CD pipelines; Perform defect tracking, root cause analysis, and issue-resolution support; Prepare test plans, test cases, automation scripts, execution reports, and quality metrics
Seniority
Senior, hands-on IC
