CareerPlan

AI - Software Development Engineer in Test (AI - SDET)

IndiaFull-time2026-11-11 → 2026-11-16
On-site

Core

Design scalable automation frameworks and AI evaluation systems to ensure the reliability, safety, accuracy, and performance of AI-driven solutions, including LLMs, AI agents, and copilots.

Role type

Senior IC AI Software Development Engineer in Test (SDET)

Builds

Robust, cloud-native applications and automated validation pipelines for AI systems

Domain

Artificial Intelligence / Machine Learning / Quality Engineering

Deliverable

production ML models

Required skills

Python, AI/LLM testing, Prompt Engineering, Context Engineering, RAG systems, AI agents, CI/CD pipelines, Docker, Kubernetes, Cloud platforms (AWS/Azure/OCI/GCP), API testing, UI automation, SQL

Preferred skills

Robot Framework, Playwright, LangChain, LangGraph, CrewAI, Semantic Kernel, Model Context Protocol (MCP), Vector databases, MLOps, Performance testing, Security testing, AI governance

Technologies

Python, Robot Framework, Playwright, Selenium, Cypress, LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel, Pinecone, Weaviate, ChromaDB, Qdrant, FAISS, GitHub Actions, Jenkins, GitLab CI/CD, Azure DevOps, Docker, Kubernetes, AWS, Azure, OCI, GCP

Responsibilities

Design and implement testing strategies for AI-powered applications, copilots, and autonomous agents; Develop AI evaluation frameworks to assess hallucinations, bias, and response quality; Build automated validation pipelines for LLM outputs; Create synthetic and benchmark datasets; Test multi-agent orchestration workflows and Model Context Protocol (MCP) integrations; Develop and maintain UI/API automation frameworks; Integrate automated testing into CI/CD pipelines; Validate RAG architectures and vector search relevance; Perform cloud-based testing and deployments across major cloud providers; Monitor AI system behaviour using observability tools.

Seniority

Senior, hands-on IC