Tech Lead - Testing & Quality Assurance P 4C
Core
Lead the design, optimization, and standardization of annotation processes and prompts for AI use cases while ensuring quality and governance of AI outputs.
Role type
Senior IC QA/AI Governance Lead
Builds
AI annotation schemas, evaluation rubrics, and prompt frameworks
Domain
Artificial Intelligence / Quality Assurance
Deliverable
production ML models
Required skills
Prompt Engineering, AI Annotation Governance, Quality Benchmarking, Bias Detection, Process Standardization, Technical Leadership
Preferred skills
AI Model Evaluation, Responsible AI Initiatives, Calibration Protocols
Technologies
Appium, Cucumber, Cypress.io, Selenium, TOSCA, iTKO LISA
Responsibilities
Lead design and standardization of annotation processes and prompts; Review complex AI outputs and provide quality judgments; Establish quality benchmarks and calibration processes; Identify bias and hallucinations in AI outputs; Mentor junior annotators and prompt engineers.
Seniority
Senior, hands-on IC with leadership responsibilities