CareerPlanGet AI match score →

Safeguards Enforcement Analyst, Child Safety

San Francisco, CA💼 Full-time💰 $245,000–$245,000🗓 2026-07-11 → 2026-07-31

Core

Operational management of child safety content review workflows to detect and respond to CSAM/CSEM in AI products.

Role type

Senior Trust & Safety Operations Lead (Child Safety)

Builds

Scalable content review workflows and enforcement systems for Anthropic's AI products

Domain

AI Safety / Child Protection / Trust & Safety

Deliverable

production ML models | product features | dashboards & analysis | client delivery | infrastructure | physical/clinical work

Required skills

Trust & safety operations, content moderation workflow management, SQL/data analysis, cross-functional stakeholder communication, policy enforcement scaling, emerging risk identification

Preferred skills

Child safety subject matter expertise (CSEA/CSAM), NCMEC/IWF reporting experience, legal/regulatory framework knowledge (KOSA/COPPA), generative AI misuse understanding, trauma-informed support design, Python, hash-matching technologies (PhotoDNA/CSAI Match), age assurance technologies

Technologies

SQL, Python, PhotoDNA, CSAI Match, hash-matching tools

Responsibilities

Manage day-to-day operational management of child safety content review workflows including task routing, queue management, escalation handling, and SLA monitoring; Serve as primary point of contact for review partners conducting child safety content review including onboarding, training, quality assurance, and ongoing relationship management; Design and improve enforcement workflows to scale effectively as volume grows while maintaining high accuracy and consistency; Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for CSAM, CSEM, and related child safety policy violations; Review novel or ambiguous flagged content to drive enforcement decisions and surface policy gaps to the Safeguards policy design team; Develop and maintain internal documentation, decision trees, and review guidelines that enable accurate and consistent enforcement at scale; Identify and report trends in misuse patterns to internal stakeholders including Policy, Legal, and Trust & Safety leadership; Coordinate reporting obligations to relevant external bodies (e.g., NCMEC) in accordance with applicable law and Anthropic policy

Seniority

Senior, hands-on IC with operational leadership

Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Greenhouse ↗