CareerPlan

Software Engineer, Cybersecurity Benchmarks

USRemoteFull-time$150k–$350k2026-11-11 → 2026-11-16
Remote

Core

Design, develop, and maintain cybersecurity benchmarks and secure sandboxing environments to evaluate the capabilities of advanced AI models.

Role type

Senior IC software engineer (AI cybersecurity benchmarks)

Builds

Evaluation frameworks, benchmark suites, and secure sandboxing environments for AI models

Domain

Artificial Intelligence + Cybersecurity

Deliverable

production ML models

Required skills

Software engineering, software sandboxing, red teaming, agentic AI systems, threat modeling, AI coding harnesses

Preferred skills

AI system benchmarking, CTF infrastructure, modern AI tools for red teaming, Inspect AI framework

Technologies

Inspect library

Responsibilities

Design and develop cybersecurity benchmarks for AI capabilities; prototype new benchmark concepts and methodologies; maintain and improve benchmark suites; design and implement secure sandboxing environments; monitor emerging AI agent developments; apply threat modeling techniques; integrate with AI providers; collaborate with researchers and engineers on evaluation data.

Seniority

Senior, hands-on IC