Senior Machine Learning Test Engineer United Kingdom
Core
Define and uphold quality standards for ML systems by designing evaluation suites, automating QA workflows, and building quality gates for training and deployment pipelines.
Role type
Senior Machine Learning QA Engineer (Research Enablement)
Builds
Production ML evaluation frameworks, automated test harnesses, and quality gates for CAD RL models.
Domain
Computer-Aided Design (CAD) / Machine Learning
Deliverable
production ML models
Required skills
Python, test automation, CI/CD pipeline integration, ML model evaluation, API testing, software architecture design, regression testing, drift detection, code review, technical documentation
Preferred skills
Data validation tooling (Great Expectations), ML frameworks (PyTorch, TensorFlow), data orchestration (Airflow, Metaflow), MLOps practices, cloud platforms (AWS, Azure, GCP), experiment tracking (Comet, MLflow, W&B), production ML service testing
Technologies
Python, GitHub Actions, Jenkins, PyTorch, TensorFlow, Airflow, Metaflow, AWS, Azure, Google Cloud Platform, Comet, MLflow, W&B, Great Expectations
Responsibilities
Define ML quality strategy and acceptance criteria; Design and maintain model evaluation suites and test datasets; Evaluate CAD RL model outputs for geometric validity; Automate ML QA workflows using CI/CD; Create and maintain test harnesses for ML services; Mentor teams on ML QA best practices; Build quality gates for training and deployment pipelines.
Seniority
Senior, hands-on IC
