Sr. Engineer - Testing & Quality Assurance P 4B
Core
Lead the design, optimization, and standardization of annotation processes and prompts for AI use cases, ensuring quality judgments and governance.
Role type
Senior QA Engineer (AI Prompt & Annotation Governance)
Builds
Annotation schemas, taxonomies, evaluation rubrics, and prompt frameworks for AI models.
Domain
Artificial Intelligence / Prompt Engineering / Data Annotation
Deliverable
production ML models
Required skills
Prompt Engineering, Annotation Schema Design, AI Quality Governance, Bias Detection, Calibration Processes, Test Process Improvement, Agile Methodology, Automated Testing, QA Automation
Preferred skills
Data-driven insights, Process improvement, Mentoring
Technologies
Cucumber, Cypress.io, Selenium, TOSCA, Appium, iTKO LISA
Responsibilities
Lead design and standardization of annotation processes and prompts; Collaborate with AI teams to define annotation schemas and evaluation rubrics; Review high-risk AI outputs and provide quality judgments; Establish quality benchmarks and calibration protocols; Identify bias and hallucinations in AI outputs; Mentor junior annotators and prompt engineers.
Seniority
Senior, hands-on IC with mentorship responsibilities
