Senior QA AI Engineer
Core
Leads quality engineering and AI testing initiatives for reliable, scalable, and secure cloud-based software solutions, focusing on validating large language model behavior and agentic AI workflows.
Role type
Senior IC QA Engineer (AI/ML)
Builds
Automated evaluation frameworks, test suites for backend services/APIs, and quality gates within CI/CD pipelines.
Domain
Cloud-native SaaS, AI/ML, Security
Deliverable
production ML models
Required skills
AI testing strategies, LLM output validation, agentic AI testing, prompt injection testing, automated test frameworks, CI/CD integration, database validation, cloud platform testing
Preferred skills
MCP familiarity, responsible AI practices, performance/load testing, mentoring
Technologies
Selenium, TestNG, JUnit, RestAssured, Cucumber, PostgreSQL, Microsoft SQL Server, AWS, Microsoft Azure
Responsibilities
Design advanced testing strategies for backend services, APIs, and microservices; Develop automated evaluation frameworks for non-deterministic AI outputs; Conduct AI-focused security testing including prompt injection and adversarial input validation; Collaborate with ML and product teams to establish testable requirements; Monitor and report quality and AI observability metrics; Integrate automated testing into CI/CD pipelines.
Seniority
Senior, hands-on IC (via careerplan.io/jobs/3ebab6b4-4bfa-4b47-8510-a5fe85ba7fac-senior-qa-ai-engineer-at-jobgether)
