Business Analyst II
Core
Design and execute adversarial testing programs to identify vulnerabilities, abuse vectors, and emerging threats in Trust & Safety systems, including AI/ML models and enforcement workflows.
Role type
Senior IC Business Analyst (Trust & Safety / Adversarial Testing)
Builds
Adversarial datasets, benchmark sets, attack corpora, test scenarios, and evaluation frameworks for Trust & Safety defenses.
Domain
Trust & Safety, AI/ML Security, Fraud Prevention, Online Platform Integrity
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Adversarial testing design, threat modeling, red-team evaluation, data-driven vulnerability discovery, attack pattern analysis, ground truth establishment via labeling/adjudication, cross-functional stakeholder management, SQL, Power BI, Python
Preferred skills
Generative AI/LLM security knowledge, jailbreak/prompt attack familiarity, experimentation design, error analysis, risk mitigation strategy
Technologies
SQL, Power BI, Python
Responsibilities
Simulate real-world attacker behaviors and fraud tactics to uncover system weaknesses; Create adversarial datasets and test scenarios to evaluate system robustness; Perform hands-on labeling, content review, and adjudication to establish ground truth; Partner with Engineering and Data Science to improve model performance through feedback loops; Define red-teaming methodologies and attack taxonomies; Monitor external abuse trends and emerging AI-powered attack techniques.
Seniority
Senior, hands-on IC