AI QA Engineer
Core
Designing, developing, and maintaining automated and reusable AI/LLM test flows and end-to-end tests for web applications and REST APIs.
Role type
Senior AI QA Engineer
Builds
Production test pipelines and quality assurance for AI/LLM agents and web applications
Domain
Web development, Cloud infrastructure, AI/LLM
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Playwright (TypeScript), TypeScript, JavaScript, REST API testing, LLM pipeline testing, Prompt tuning, JSON/schema output definition, System debugging, CI/CD integration, Git, Docker, Kubernetes, Postgres, PHP/Laravel architecture
Preferred skills
Azure cloud experience, MCP tools knowledge, Structured data modeling
Technologies
Playwright, TypeScript, JavaScript, HTML, CSS, Postman, Docker, Kubernetes, Azure, Git
Responsibilities
Designing and maintaining automated test flows in Playwright, Developing and integrating AI/LLM pipelines and agents, Working with prompts and defining structural outputs, Realizing and maintaining end-to-end tests, Testing web applications (frontend + backend), Preparing and maintaining test cases and quality documentation, Testing and validating REST APIs, Analyzing results and reporting bugs, Debugging system flows from AI to API to application, Identifying and solving problems with authentication, cookies, environments, and AI-generated scenarios, Collaborating with the development team, Working with Git and CI/CD pipelines, Actively participating in Scrum ceremonies
Seniority
Senior, hands-on IC
