Responsible Content Analyst 2
Core
Investigate malicious code generation, phishing, and abuse workflows; adjudicate user prompts and model outputs using Responsible AI policies to distinguish harmful from benign activity.
Role type
Senior IC Responsible Content Analyst (AI Safety & Trust)
Builds
AI safety systems, moderation guidelines, classifier definitions, and enforcement strategies for generative AI platforms.
Domain
Cybersecurity, Responsible AI, Trust & Safety
Deliverable
production ML models | dashboards & analysis | client delivery
Required skills
Evidence-based investigation, cyber threat analysis (phishing, malware, MITRE ATT&CK), data analysis (SQL, Kusto, Python, Power BI), generative AI risk assessment, policy adjudication, complex scenario judgment.
Preferred skills
Red-teaming AI systems, developing abuse taxonomies, managing high-risk escalations, cross-functional partnership with engineering and security teams.
Technologies
SQL, Kusto Query Language, Python, Power BI, MITRE ATT&CK, STIX/TAXII, MISP
Responsibilities
Investigate potential malicious code generation, phishing, and social engineering; Review and adjudicate user prompts and model outputs using Responsible AI policies; Analyze safety and operational data to identify trends and support enforcement; Develop and validate moderation guidelines and classifier definitions; Translate investigative findings into recommendations for product mitigations.
Seniority
Senior, hands-on IC