Senior QA Automation Engineer
Core
Design and maintain automated test suites, evaluation scenarios, and quality gates for AI-powered applications and machine learning models.
Role type
Senior QA Automation Engineer (AI/ML)
Builds
Scalable testing frameworks, test harnesses for AI services/APIs, and CI/CD quality gates for AI features.
Domain
Artificial Intelligence / Machine Learning / Software Quality Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, automated testing, CI/CD pipelines, API testing, test framework design, AI-powered testing tools, UAT, software architecture understanding
Preferred skills
ML model validation, data validation tooling, ML frameworks (PyTorch, TensorFlow), data pipelines, MLOps, experiment tracking tools, cloud platforms
Technologies
Python, GitHub Actions, Jenkins, Great Expectations, PyTorch, TensorFlow, Airflow, AWS, Azure, GCP, Comet, MLflow, Weights & Biases
Responsibilities
Design and maintain automated test suites and evaluation metrics for AI features; Automate QA workflows using Python and CI/CD; Create test harnesses for AI services and APIs; Define quality strategy and acceptance criteria for AI applications; Evaluate AI/ML model outputs for correctness and consistency; Build structured rubrics and quality gates for deployment pipelines; Mentor teams on QA automation best practices.
Seniority
Senior, hands-on IC