CareerPlan

Software Engineers, Data Scientists, and experts in finance, medicine, law, science and engineering at Cocient

AI training & evaluationRemoteFull-time$104k–$520k2026-11-02 → 2026-11-10
RemoteFreelance / independent contractor

Core

Produce evals and training data for AI labs by writing hard, realistic problems in your field, grading model answers, and identifying where a model's reasoning breaks.

Role type

Independent contractor AI training & evaluation specialist

Builds

Training data and evaluation sets for AI models

Domain

Artificial Intelligence / Machine Learning

Deliverable

production ML models

Required skills

Domain expertise in software engineering, data science, finance, medicine, law, science, or engineering

Preferred skills

Experience writing realistic problems, grading model outputs, analyzing model reasoning

Technologies

AI training platforms, LLMs

Responsibilities

Write hard, realistic problems in your field; grade model answers; identify where a model's reasoning breaks