Senior Master Annotator
Core
Define, maintain, and improve annotation standards for robotic datasets (image, video, 3D, audio) to serve as the gold standard for model training.
Role type
Senior Master Annotator (Data Quality & Standards)
Builds
Gold-standard datasets, annotation guidelines, SOPs, and quality frameworks for robotics model training
Domain
Robotics, Computer Vision, Data Annotation
Deliverable
production ML models
Required skills
Inter-Annotator Agreement (IAA) methodologies, temporal video annotation, gold set creation, annotation guideline development, quality audit execution, annotator training and calibration, edge-case library management, data analysis (Excel/Sheets)
Preferred skills
Robotics or autonomous systems dataset experience, Python proficiency, mentoring experience
Technologies
Cohen's/Fleiss' kappa, Excel, Google Sheets, Python
Responsibilities
Define and maintain gold-standard annotations and benchmark datasets; Establish acceptance criteria and task-specific quality standards; Develop and refine annotation guidelines and SOPs; Design and implement IAA frameworks and produce quality reports; Analyze disagreement trends and recommend process improvements; Lead onboarding and training for annotators; Conduct precision-based QC audits and validate pilot batches; Review escalated edge cases and partner with QA/Operations teams
Seniority
Senior, hands-on IC
