EY - GDS Consulting - AIA - Gen AI - Senior
Core
Design, develop, and execute comprehensive testing strategies, validation frameworks, and automated suites for AI, GenAI, Agentic AI, and RAG systems to ensure quality, reliability, and safety.
Role type
Senior AI Quality Assurance Engineer (GenAI/Agentic AI)
Builds
Production-ready AI applications, copilots, and enterprise AI platforms
Domain
Generative AI, Agentic AI, Large Language Models (LLMs), Retrieval Augmented Generation (RAG)
Deliverable
production ML models | product features
Required skills
AI testing strategy design, LLM output validation, automated test framework development, RAG evaluation (Ragas), adversarial/prompt injection testing, AI security validation, bias and hallucination assessment, Python scripting, API testing, CI/CD integration, vector database testing
Preferred skills
Experience with Microsoft Azure AI Platform, FastAPI, model fine-tuning, multimodal AI testing, presales technical demonstrations
Technologies
Python, Ragas, Microsoft Azure AI, FastAPI, Vector databases, LLMs, RAG pipelines
Responsibilities
Design and execute testing strategies for AI and GenAI systems; Validate LLM outputs for accuracy, safety, and compliance; Develop automated testing frameworks using Python; Perform AI penetration and adversarial testing; Assess AI solutions for bias, hallucinations, and responsible AI compliance; Collaborate with AI engineers to establish quality standards and governance controls.
Seniority
Senior, hands-on IC with mentorship responsibilities
