Sr. AI Engineer 4B
Core
Build and execute automated test suites for traditional application layers and AI-powered components (LLM responses, RAG pipelines, agentic workflows) within Genpact's AI Gigafactory.
Role type
Senior QA Automation Engineer (AI/GenAI)
Builds
Automated test suites for APIs, UI, integrations, and AI model endpoints
Domain
Enterprise AI / Generative AI / Software Quality Assurance
Required skills
Test automation frameworks (Selenium, Cypress, Playwright), API testing (REST, Postman, RestAssured), CI/CD integration (Jenkins, GitHub Actions, Azure DevOps), Cloud testing (AWS, Azure), Python or Java programming, Defect management (Jira, HP ALM), LLM output validation
Preferred skills
AI/LLM evaluation frameworks (Ragas, DeepEval, Promptfoo, LangSmith), RAG pipeline testing, Performance/load testing (JMeter), Containerization (Docker, Kubernetes), Responsible AI testing concepts, GCP experience
Technologies
Selenium, Cypress, Jmeter, Playwright, Postman, RestAssured, Jenkins, GitHub Actions, Azure DevOps, AWS, Azure, Jira, HP ALM, Python, Java, Docker, Kubernetes, Ragas, DeepEval, Promptfoo, LangSmith, Langfuse
Responsibilities
Build, maintain, and execute automated test scripts for functional, integration, and regression testing; Design and execute REST API test cases for AI/model endpoints; Validate GenAI and agentic application behavior including LLM responses and hallucination checks; Integrate automated test suites into CI/CD pipelines; Execute and validate test cases for applications deployed on AWS or Azure; Log, track, and triage defects using Jira/HP ALM; Prepare test cases, test data, execution reports, and coverage metrics; Assist in defining test plans and strategies for new AI/GenAI features.
Seniority
Senior, hands-on IC
