QA Engineer | Remote - Contract
Core
Evaluate and rate AI-generated technical outputs against quality criteria and rubrics, while designing and executing comprehensive software test cases for functional, regression, and edge-case scenarios.
Role type
Contractor QA Engineer (AI Evaluation & Software Testing)
Builds
High-quality AI training data and validated software features for next-generation AI systems
Domain
Artificial Intelligence / Software Quality Assurance
Deliverable
production ML models | product features
Required skills
Quality Assurance, Software Testing, Test Case Design, Automation Testing, Regression Testing, Bug Tracking, Test Management Tools, Selenium, Manual & Automated Testing, Bug Reporting, Quality Evaluation, Human Data Annotation
Preferred skills
RLHF experience, Rubric-based grading, Model output evaluation, Playwright, Cypress, Appium, Postman, Jira, TestRail, Zephyr, BrowserStack, Analytical problem-solving, Written English communication (B2+)
Technologies
Selenium, Playwright, Cypress, Appium, Postman, Jira, TestRail, Zephyr, BrowserStack
Responsibilities
Evaluate and rate AI-generated technical outputs against defined quality criteria and rubrics, Design and assess comprehensive test cases for functional, regression, and edge-case scenarios, Review bug reports and test documentation to ensure issues are reproducible and severity is properly assessed, Identify, isolate, and document defects with precise reproduction steps, Provide detailed, actionable written feedback and annotations to support efficient resolution by developers, Collaborate with project teams to refine evaluation guidelines and ensure continuous improvement of testing standards
Seniority
Mid-level to Senior, hands-on IC