Subject Matter Expert
Core
Conduct quality audits, define evaluation standards, and analyze output quality for AI training data projects.
Role type
Senior IC quality assurance specialist (auditing & standards)
Builds
High-quality datasets and evaluation frameworks for AI models
Domain
AI/ML data quality assurance
Deliverable
production ML models
Required skills
domain expertise, quality auditing, analytical evaluation, standards definition, report generation, process improvement
Preferred skills
experience in QA/auditing frameworks, calibration
Technologies
N/A
Responsibilities
Conduct structured audits of task outputs to evaluate accuracy and adherence to guidelines; Define and refine quality benchmarks and scoring rubrics; Analyze audit results to generate actionable insights on quality trends; Recommend improvements to workflows and evaluation processes; Partner with stakeholders to calibrate quality expectations; Contribute to continuous improvement initiatives related to quality outcomes.