AI Quality Analyst - Flexible Hours
Core
Evaluate, label, and generate data to train, fine-tune, and assess the performance of Generative AI models and Large Language Models (LLMs).
Role type
Generative AI Specialist (SME on Demand)
Builds
Training datasets, evaluation frameworks, and model performance assessments for AI builders.
Domain
Artificial Intelligence / Generative AI / Data Engineering
Deliverable
production ML models
Required skills
Rating AI model outputs, content labeling, data transformation (text/image/audio), prompt engineering, content summarization, translation, transcription, data compilation
Preferred skills
Advanced degrees (Master's/PhD) in humanities
Technologies
LLMs, Generative AI systems
Responsibilities
Rate AI model performance based on output, label content elements, assign predefined categories, evaluate content quality/appropriateness, generate training data via transformations, review data against guidelines, rank items based on criteria, create prompts for AI systems, evaluate content relevance, generate AI responses, rewrite text for clarity, summarize text, transcribe audio, translate languages, compile diverse data types
Seniority
Contractor/Freelance, flexible hours
