AI Agent Operations Specialist （Model Data Operations) - TikTok Platform Safety
Core
Lead strategy operations and prompt optimization for a large model Agent to evaluate TikTok content safety and ensure precise recall of risky content.
Role type
Senior IC AI Agent Operations Specialist (Model Data Operations)
Builds
Large model Agents for content risk detection and governance
Domain
Social Media / Content Safety / LLM Operations
Deliverable
production ML models
Required skills
Prompt Engineering, Few-shot sample management, Root cause analysis, RAG knowledge base maintenance, Data analysis, LLM principles
Preferred skills
Stakeholder influence, adaptability in ambiguous environments
Technologies
LLMs, RAG systems, Prompt version libraries
Responsibilities
Write and debug prompts for specific risk scenarios; Maintain high-quality few-shot sample libraries; Analyze false negatives/positives to refine prompt strategies; Maintain external knowledge bases for political and person-related risks; Monitor metrics and troubleshoot abnormal fluctuations.
Seniority
Senior, hands-on IC
