Data Annotation Specialist, Safety
Core
Evaluate and improve the safety of Large Language Models by labeling, ranking, auditing, and refining human- and model-generated text to prevent unsafe outputs.
Role type
Independent contractor data annotation specialist (safety)
Builds
Safer AI models for developers and enterprises building content generation, search, and agent systems
Domain
Artificial Intelligence / Large Language Model Safety
Deliverable
production ML models
Required skills
Content moderation, AI data annotation, LLM evaluation, prompt engineering, red teaming, applying nuanced safety guidelines, emotional resilience, written English proficiency
Preferred skills
Fluency in another language, experience with quality assurance, experience with adversarial examples
Technologies
Large Language Models (LLMs), chat bots
Responsibilities
Label and audit text to improve safety and policy alignment, create prompts and safety test cases, identify annotation inconsistencies and provide feedback on edge cases, work independently in a remote asynchronous environment
Seniority
Entry-level to Mid-level, independent contractor