Senior Quality Engineer, AI and Automation
Core
Define and drive quality strategy for next-generation AI-enabled products and platforms, designing scalable automated test frameworks and validating AI-generated outputs.
Role type
Senior Quality Engineer (AI and Automation)
Builds
Scalable automated test frameworks, validation approaches for AI workflows, and quality metrics dashboards.
Domain
Enterprise AI, Software Quality Engineering, Test Automation
Deliverable
production ML models
Required skills
Test automation framework design, AI output validation, CI/CD integration, Java/Python programming, UI/API/E2E testing, Agile methodologies, Risk analysis, Technical mentorship
Preferred skills
AI/LLM testing, AI evaluation frameworks (DeepEval, LangSmith, Ragas), RAG system validation, Cloud platforms (AWS/Azure/GCP), Observability tools
Technologies
Playwright, Selenium, Cypress, Git, AWS, Azure, GCP
Responsibilities
Define and execute quality strategies for AI products; Design and maintain automated test frameworks; Create test plans for functional, integration, and performance testing; Develop validation approaches for AI outputs; Establish quality metrics and dashboards; Integrate tests into CI/CD pipelines; Identify and resolve quality risks; Evaluate AI-powered testing tools; Mentor engineers and drive quality initiatives.
Seniority
Senior, hands-on IC with strategic influence