AI QA Engineer
Core
Design and run quality strategies for AI-driven data management platform features, ensuring accuracy, latency, and cost efficiency alongside functional correctness.
Role type
AI QA Engineer
Builds
Automated testing solutions and quality metrics for non-deterministic AI outputs
Domain
Data management, cloud infrastructure, and artificial intelligence
Deliverable
production ML models | product features
Required skills
Python, Java, Go, SQL, NoSQL, Kubernetes, cloud platforms (AWS/Azure/GCP), test automation, CI/CD
Preferred skills
AI/ML testing, prompt regression testing, model evaluation harnesses, AI-assisted QA automation
Technologies
Python, Java, Go, AWS, Azure, Google Cloud, Kubernetes, SQL, NoSQL
Responsibilities
Design quality strategies for AI features including evaluation datasets and regression suites; Create and maintain test automation across unit, integration, and end-to-end layers; Collaborate with stakeholders to define requirements and drive solutions to production; Contribute to engineering best practices including code reviews and documentation; Experiment with new technologies and AI-assisted approaches to improve automation; Share testing expertise to support team-wide continuous improvement.
Seniority
Mid-level, hands-on IC