Software Development Engineer in Test - Agentic Automation
Core
Design, develop, and maintain automated test suites and frameworks for distributed, cloud-based systems, specifically focusing on AI agents, agentic test generation, and eval-driven development.
Role type
Senior SDET specializing in AI agent testing and automation
Builds
Automated test frameworks, agentic test generation capabilities, AI-powered workflows, and evaluation suites for cybersecurity platforms
Domain
Cybersecurity, Cloud Infrastructure, AI/ML
Deliverable
production ML models
Required skills
Test automation framework design, AI agent evaluation, CI/CD integration, Performance/load testing, API testing (REST, gRPC), Python, Java, Node.js
Preferred skills
LLM-as-judge calibration, Prompt engineering, Observability tools (Grafana, Prometheus, CloudWatch), Cybersecurity background, LLM APIs and agent frameworks
Technologies
Python, Java, Node.js, Jenkins, GitLab CI/CD, Locust, k6, MongoDB, MinIO, RabbitMQ, Kafka, AWS (EC2, S3, DynamoDB), Docker, Nomad, Terraform, Unix/Linux, Git, Jira, Bitbucket
Responsibilities
Design and maintain automated test suites for distributed cloud systems; Build AI-powered workflows to reduce manual testing effort; Maintain evaluation suites and scoring pipelines for AI agents; Implement CI evaluation gates for prompts, models, and tools; Identify and mitigate unreliable AI outputs; Execute performance, load, and stress tests; Review product and agent designs for testability.
Seniority
Senior, hands-on IC
