Cyber Evaluations Engineer
Core
Design and run evaluations to measure cyber-relevant capabilities and safeguard robustness in AI models, including analyzing jailbreaks and prompt bypasses.
Role type
Senior IC Cyber Evaluations Engineer
Builds
AI safety evaluation frameworks, detection probes, and robustness testing suites
Domain
AI Safety / Cybersecurity
Deliverable
production ML models
Required skills
evaluation design, cybersecurity research, Python, data analysis, stakeholder communication
Preferred skills
offensive security, AI security benchmarks, adversarial data analysis, government partner testing, AI/ML evaluation frameworks, vulnerability disclosure, detection rule authoring
Technologies
Sigma, YARA, Suricata, SIEM
Responsibilities
Design and run capability and safety evaluations; execute per-release robustness testing; analyze evaluation results; design and tune detection probes; collaborate on abuse-detection architecture; build internal evaluation tooling
Seniority
Senior, hands-on IC