Software Engineer, Cybersecurity Benchmarks
Core
Design, develop, and maintain cybersecurity benchmarks and secure sandboxing environments to evaluate the capabilities of advanced AI models.
Role type
Senior IC software engineer (AI cybersecurity benchmarks)
Builds
Evaluation frameworks, benchmark suites, and secure sandboxing environments for AI models
Domain
Artificial Intelligence + Cybersecurity
Deliverable
production ML models
Required skills
Software engineering, software sandboxing, red teaming, agentic AI systems, threat modeling, AI coding harnesses
Preferred skills
AI system benchmarking, CTF infrastructure, modern AI tools for red teaming, Inspect AI framework
Technologies
Inspect library
Responsibilities
Design and develop cybersecurity benchmarks for AI capabilities; prototype new benchmark concepts and methodologies; maintain and improve benchmark suites; design and implement secure sandboxing environments; monitor emerging AI agent developments; apply threat modeling techniques; integrate with AI providers; collaborate with researchers and engineers on evaluation data.
Seniority
Senior, hands-on IC
