CareerPlan

Software Development Engineer in Test - Agentic Automation (Remote, CAN)

Canada - Remote ABRemoteFull-timeCA$120k–CA$170k2026-11-04 → 2026-11-10
Remote

Core

Build and maintain functional, integration, and performance automation for CrowdStrike's large-scale, cloud-based cybersecurity platform, specifically defining how AI agents are tested and trusted in production.

Role type

Senior SDET specializing in agentic automation and AI evaluation

Builds

Automated test suites, agentic test generation tooling, and eval-driven development pipelines for AI agents

Domain

Cybersecurity / AI / Distributed Systems

Deliverable

production ML models

Required skills

Test automation framework design, CI/CD integration, performance/load testing, AI agent evaluation, distributed systems knowledge, API testing (REST/gRPC), Python, Java, Node.js, Go

Preferred skills

End-to-end eval-driven development, prompt engineering, observability integration, cybersecurity background

Technologies

Java, Node.js, Python, Go, MongoDB, MinIO, RabbitMQ, Kafka, AWS, Docker, Nomad, Terraform, Locust, k6, LLM APIs

Responsibilities

Design and maintain automated test suites for distributed cloud systems; Build AI-powered workflows to automate manual test toil; Maintain eval suites and scoring pipelines for AI agents; Enforce CI eval gates for model and prompt changes; Detect and mitigate unreliable AI output; Design and analyze performance and stress tests; Validate system integrations end-to-end

Seniority

Senior, hands-on IC