Software Engineering Technical Leader
Core
Building test infrastructure and evaluation frameworks for an AI-agentic Security Operations Center (SOC) to ensure system reliability and performance.
Role type
Senior IC Software Engineering Technical Leader (AI/ML Testing & Infrastructure)
Builds
Scalable testing ecosystems, AI-based agents, and benchmarking protocols for complex security systems.
Domain
Cybersecurity / AI/ML Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, Go, large-scale test automation, security compliance frameworks, modern performance testing methodologies, AI-driven automation design
Preferred skills
LLM APIs (Claude, Codex), prompt engineering, agentic workflows, LangChain, LangSmith, LLM-as-judge frameworks, contract testing, tenant isolation probes, audit log validation, K6, JMeter
Technologies
Python, Go, Playwright, Open Cybersecurity Schema Framework (OCSF), Caldera, Terra Virtual Machine, K6, JMeter, LangChain, LangSmith
Responsibilities
Develop PQ foundations and evaluation frameworks for AI agents; implement AI-based solutions to mitigate risk; collaborate on code and design reviews; execute proof-of-concepts and validate testing paradigms; maintain quality ecosystem alignment; implement validation techniques like LLM-as-judge and behavioral regression suites; partner on contract testing and security compliance.
Seniority
Senior, hands-on IC with strategic direction