CareerPlanSign in

Staff+ Software Engineer, Account Creation

San Francisco, CA💼 Full-time💰 $320,000–$320,000🗓 2026-09-24 → 2026-09-25

Core

Build safety and oversight mechanisms to monitor AI models, detect abuse, and prevent misuse across API partners.

Role type

Staff+ Software Engineer (AI Safety & Safeguards)

Builds

Real-time abuse detection systems, monitoring dashboards, and multi-layered defense infrastructure for AI models.

Domain

Artificial Intelligence / AI Safety / Trust & Safety

Deliverable

production ML models | infrastructure

Required skills

Python, TypeScript, full-stack development, abuse detection, fraud detection, adversarial input handling, prompt engineering, internal tooling development

Preferred skills

Experience with jailbreak attacks, trust and safety mechanisms for AI/ML, collaboration with operational teams

Technologies

Python, TypeScript

Responsibilities

Develop monitoring systems to detect unwanted behaviors from API partners; build abuse detection mechanisms and infrastructure; surface abuse patterns to research teams; build robust multi-layered defenses for real-time safety improvements.

Seniority

Staff+, hands-on IC with strategic impact

Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.