QA ENGINEER — Engenheiro(a) de Qualidade - Híbrido 4x1
Core
Ensuring quality for an AI orchestration platform that generates functional specs, configurations, and test artifacts for complex SAP implementations.
Role type
Senior QA Engineer (Software & AI Evaluation)
Builds
Automated test suites, evaluation frameworks for LLM outputs, and quality gates for production releases.
Domain
Enterprise Software / SAP Implementation / AI Orchestration
Deliverable
production ML models | product features
Required skills
Python, TypeScript, E2E testing, API testing, CI/CD pipeline management, LLM evaluation, non-deterministic system testing, defect severity assessment, autonomous process building
Preferred skills
LLM/Agent evaluation experience, hallucination detection, Human-in-the-Loop processes, SAP/ERP/CRM ecosystem knowledge, performance/security testing, bug fixing
Technologies
Playwright, Cypress, Tricentis, Worksoft
Responsibilities
Build and maintain automated E2E, integration, and regression test suites; Create evaluation mechanisms and golden datasets for LLM-generated responses; Define quality gates and release blocking criteria; Identify regressions after prompt or model changes; Execute exploratory and release testing; Screen defects and track resolution; Transform failure patterns into product roadmap improvements
Seniority
Senior, hands-on IC
