CareerPlan

Product Validation Engineer II: AI Agent Quality Assurance (QA)

BELO HORIZONTE, BRFull-time2026-09-29 → 2026-11-15

Core

Validate AI Agent products and customer workflows through structured test planning, execution, and quality evaluation.

Role type

Product Validation Engineer (AI Agent QA)

Builds

AI Agent products and customer workflows

Domain

Semiconductor design tools / AI Agents

Deliverable

production ML models

Required skills

Test planning and execution, AI/LLM concepts, Python scripting, defect analysis, quality rubrics, regression testing

Preferred skills

AI evaluation frameworks, red-team testing, vector databases, EDA/VLSI design verification

Technologies

Python, RAG workflows, vector databases, embeddings, agent orchestration frameworks

Responsibilities

Validate AI Agent products and customer workflows; Test agent behavior across prompts, tool usage, and response consistency; Evaluate agent outputs using quality rubrics and metrics; Create and expand testcase suites and evaluation datasets; Document defects and support root-cause triage; Collaborate with product and engineering teams to improve quality.

Seniority

Mid-level, hands-on IC