Senior QA Engineer ( Manual & Automation )
Core
Senior Quality Engineer owning end-to-end quality for AI and LLM-powered products, designing test strategies, manual/exploratory testing, and evaluation frameworks.
Role type
Senior IC Quality Engineer (AI/LLM focus)
Builds
AI systems, LLM-powered features (assistants, RAG, agents), and digital products
Domain
Artificial Intelligence, Large Language Models (LLM), Software Quality Engineering
Deliverable
production ML models
Required skills
Manual and automation testing, Test strategy design, UI automation (Playwright, Cypress, Selenium, Appium), API testing (Postman, RestAssured, Pytest), CI/CD (GitHub Actions, GitLab CI, Jenkins), Scripting (JavaScript/TypeScript, Python, Java), Risk-based testing, LLM evaluation (evals, datasets, hallucination testing), Defect management, Release readiness
Preferred skills
Performance/load testing (k6, Locust, JMeter), Security testing (OWASP), SQL, LLM observability, LLM-as-judge graders
Technologies
Playwright, Cypress, Selenium, Appium, Postman, RestAssured, Pytest, GitHub Actions, GitLab CI, Jenkins, Jira, Linear, Asana, Qase, TestRail, Xray, Zephyr, k6, Locust, JMeter, Claude, Cursor, Copilot
Responsibilities
Define test strategies based on product risk; Design and maintain automated test suites for UI, API, and integration; Conduct manual and exploratory testing for complex flows and visual checks; Build and maintain evaluation datasets and criteria for LLM features (groundedness, hallucination, safety); Triage and track defects; Own release validation and quality gates; Make go/no-go decisions backed by evidence
Seniority
Senior, hands-on IC