QA Engineer AI & Advanced Testing
Core
Designing testing strategies for non-deterministic AI systems, ensuring quality, robustness, and reliability of LLM-based solutions and knowledge graphs.
Role type
QA Engineer specializing in AI and advanced testing
Builds
Production-ready AI models, agents, and knowledge graph solutions
Domain
Artificial Intelligence, Large Language Models (LLMs), Knowledge Graphs
Deliverable
production ML models
Required skills
Designing testing strategies for non-deterministic systems, detecting complex reasoning errors and structural biases, defining quality metrics (correctness, robustness, latency), collaborating with AI engineering teams, automating tests with Playwright or Cypress, unit testing, integration testing, end-to-end testing, prompt testing, regression testing, edge case testing for agents, semantic consistency validation, knowledge graph integrity testing, LLM-generated query testing
Preferred skills
Experience with cloud environments
Technologies
Playwright, Cypress
Responsibilities
Design testing strategies for non-deterministic AI systems, ensure quality of models, agents, and knowledge graphs, detect complex reasoning errors and structural biases, define key quality metrics, collaborate with AI engineering teams, automate tests using modern tools
Seniority
Mid-level (3 years experience required)