Pingintel | Miami or Remote | Full-time | https://www.pingintel.com
Core
Lead operations for ML training data annotation, managing offshore contractors and driving quality, cost, and throughput for the property insurance sector.
Role type
Senior IC data annotation operations lead
Builds
High-quality ML training datasets for property insurance models
Domain
Property insurance + Machine Learning
Deliverable
production ML models
Required skills
offshore team management, ML annotation pipeline expertise, SQL, data quality metrics analysis, guideline creation, cost optimization
Preferred skills
Python, annotation UI/UX design, taxonomy classification, LLM/agent automation
Technologies
LLMs, agents, SQL, spreadsheets
Responsibilities
Manage offshore annotation contractors as main liaison; Write and maintain annotation guidelines; Annotate data yourself, especially early on; Track quality metrics (agreement rate, accuracy, rework) and drive improvement; Cut cost, boost throughput, without sacrificing quality; Partner with engineering to automate annotation via LLMs/agents