Data Entry Keyer | Remote - Contract
Core
Design and produce expert-level evaluation tasks, datasets, and grading rubrics to train and benchmark AI agents on data entry and validation.
Role type
Contractor AI benchmarking specialist (data entry & validation)
Builds
Evaluation tasks, complex datasets (CSVs, PDFs, spreadsheets), and grading rubrics for AI agents
Domain
AI/ML training data generation, data quality assurance
Deliverable
production ML models
Required skills
Accuracy discipline, error detection, format reconciliation, attention to detail, data validation, rubric authoring
Preferred skills
Experience in regulated domains (healthcare, finance, legal), analyzing data inconsistencies, proficient written English, process-oriented work style
Technologies
CSV, PDF, spreadsheets
Responsibilities
Design evaluation tasks simulating real-world data entry challenges, construct and curate large datasets with realistic errors, define correct final states and error cases, author detailed grading rubrics with 35+ criteria, ensure tasks mirror regulated environment standards, collaborate asynchronously to refine materials