Lead Software Development Engineer in Test - AI
Core
Define and implement scalable testing approaches and quality standards for an AI-driven product ecosystem, focusing on model evaluation, hallucination detection, and bias mitigation.
Role type
Lead Software Development Engineer in Test (AI)
Builds
AI-powered products and services
Domain
Artificial Intelligence / Machine Learning
Deliverable
production ML models
Required skills
AI model testing, test automation framework architecture, RAG testing, hallucination detection, model drift analysis, bias evaluation, technical leadership, CI/CD pipelines, cloud platforms (AWS/GCP/Azure)
Preferred skills
MLOps pipelines, performance/scalability testing of AI workloads
Technologies
AWS, Google Cloud Platform (GCP), Microsoft Azure, CI/CD pipelines, MLOps
Responsibilities
Define and lead the overall Quality Assurance (QA) strategy for AI products and engineering initiatives; Architect, develop, and implement large-scale, reusable, and cross-platform test automation frameworks; Design and implement scalable testing strategies for AI-powered systems, covering Retrieval-Augmented Generation (RAG), hallucinations, model drift, bias, and other AI-specific quality challenges; Lead, coach, and mentor the QA/SDET team, strengthening technical capabilities and encouraging continuous learning; Monitor quality metrics, identify systemic risks, and implement continuous improvement initiatives across the AI product ecosystem.
Seniority
Senior, hands-on IC with leadership responsibilities
