Safeguards Enforcement Analyst, Child Safety
Core
Operational management of child safety content review workflows to detect and respond to CSAM/CSEM in AI products.
Role type
Senior Trust & Safety Operations Lead (Child Safety)
Builds
Scalable content review workflows and enforcement systems for Anthropic's AI products
Domain
AI Safety / Child Protection / Trust & Safety
Deliverable
production ML models | product features | dashboards & analysis | client delivery | infrastructure | physical/clinical work
Required skills
Trust & safety operations, content moderation workflow management, SQL/data analysis, cross-functional stakeholder communication, policy enforcement scaling, emerging risk identification
Preferred skills
Child safety subject matter expertise (CSEA/CSAM), NCMEC/IWF reporting experience, legal/regulatory framework knowledge (KOSA/COPPA), generative AI misuse understanding, trauma-informed support design, Python, hash-matching technologies (PhotoDNA/CSAI Match), age assurance technologies
Technologies
SQL, Python, PhotoDNA, CSAI Match, hash-matching tools
Responsibilities
Manage day-to-day operational management of child safety content review workflows including task routing, queue management, escalation handling, and SLA monitoring; Serve as primary point of contact for review partners conducting child safety content review including onboarding, training, quality assurance, and ongoing relationship management; Design and improve enforcement workflows to scale effectively as volume grows while maintaining high accuracy and consistency; Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for CSAM, CSEM, and related child safety policy violations; Review novel or ambiguous flagged content to drive enforcement decisions and surface policy gaps to the Safeguards policy design team; Develop and maintain internal documentation, decision trees, and review guidelines that enable accurate and consistent enforcement at scale; Identify and report trends in misuse patterns to internal stakeholders including Policy, Legal, and Trust & Safety leadership; Coordinate reporting obligations to relevant external bodies (e.g., NCMEC) in accordance with applicable law and Anthropic policy
Seniority
Senior, hands-on IC with operational leadership