Senior Manager, Machine Learning (Data Operations)
Core
Own labeling quality and methodology across the organization to ensure data is fit for training production ML models.
Role type
Senior Manager, Machine Learning Data Operations
Builds
High-quality labeled datasets for production ML models
Domain
Machine Learning / Data Operations
Deliverable
production ML models
Required skills
ML data operations, annotation quality frameworks (IAA, gold standard), vendor management, Label Studio, Python, SQL
Preferred skills
Active learning, model-assisted labeling, insurance/cybersecurity/fintech domain experience
Technologies
Label Studio, Scale AI, Labelbox, Prodigy
Responsibilities
Define annotation guidelines, taxonomies, and edge-case protocols; manage outsourced labeling vendors and BPOs; serve as primary user and requirements driver for labeling platforms; track operational metrics (accuracy, cost, turnaround time); collaborate with ML and product teams to structure labeling programs.
Seniority
Senior, hands-on IC with management scope