AI - Software Development Engineer in Test (AI - SDET)
Core
Design scalable automation frameworks and AI evaluation systems to ensure the reliability, safety, accuracy, and performance of AI-driven solutions, including LLMs, AI agents, and copilots.
Role type
Senior IC AI Software Development Engineer in Test (SDET)
Builds
Robust, cloud-native applications and automated validation pipelines for AI systems
Domain
Artificial Intelligence / Machine Learning / Quality Engineering
Deliverable
production ML models
Required skills
Python, AI/LLM testing, Prompt Engineering, Context Engineering, RAG systems, AI agents, CI/CD pipelines, Docker, Kubernetes, Cloud platforms (AWS/Azure/OCI/GCP), API testing, UI automation, SQL
Preferred skills
Robot Framework, Playwright, LangChain, LangGraph, CrewAI, Semantic Kernel, Model Context Protocol (MCP), Vector databases, MLOps, Performance testing, Security testing, AI governance
Technologies
Python, Robot Framework, Playwright, Selenium, Cypress, LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel, Pinecone, Weaviate, ChromaDB, Qdrant, FAISS, GitHub Actions, Jenkins, GitLab CI/CD, Azure DevOps, Docker, Kubernetes, AWS, Azure, OCI, GCP
Responsibilities
Design and implement testing strategies for AI-powered applications, copilots, and autonomous agents; Develop AI evaluation frameworks to assess hallucinations, bias, and response quality; Build automated validation pipelines for LLM outputs; Create synthetic and benchmark datasets; Test multi-agent orchestration workflows and Model Context Protocol (MCP) integrations; Develop and maintain UI/API automation frameworks; Integrate automated testing into CI/CD pipelines; Validate RAG architectures and vector search relevance; Perform cloud-based testing and deployments across major cloud providers; Monitor AI system behaviour using observability tools.
Seniority
Senior, hands-on IC