Senior Manager, Machine Learning (Data Operations)
Core
Ensuring the accuracy and quality of labeled datasets used to train Coalition's machine learning models for cybersecurity and insurance risk prevention.
Role type
Senior Manager, Machine Learning Data Operations
Builds
High-quality labeled datasets for production ML models in the cybersecurity and insurance domain
Domain
Cybersecurity, Insurance, Fintech
Deliverable
production ML models
Required skills
ML data operations, annotation quality frameworks (IAA, gold standard), vendor management, Label Studio, Python, SQL
Preferred skills
Active learning, model-assisted labeling, pre-annotation, insurance/cybersecurity/fintech experience
Technologies
Label Studio, Scale AI, Labelbox, Prodigy
Responsibilities
Define annotation guidelines, taxonomies, and edge-case protocols; manage outsourced labeling vendors and BPOs; serve as primary user and requirements driver for Label Studio; track operational metrics (accuracy, cost, turnaround time); collaborate with ML engineers and product teams on task design
Seniority
Senior, hands-on IC with management scope