Senior Test Automation Engineer 100% (f/m/d)
Core
Design, implement, and maintain test automation frameworks for an AI/ML platform powering RAG systems, LLM assistants, and agentic workflows within a wealth management bank.
Role type
Senior Test Automation Engineer (AI/ML focus)
Builds
Scalable test automation frameworks, AI/ML evaluation pipelines, contract tests, and CI/CD integrated test suites.
Domain
Financial Services / Artificial Intelligence / Machine Learning
Deliverable
production ML models | product features
Required skills
Python (Playwright, pytest, requests), BDD/Gherkin, CI/CD pipeline orchestration, Docker, Kubernetes basics, API testing, test framework architecture, flaky test management, AI/ML output evaluation
Preferred skills
MLOps, RAG system testing, agentic workflow testing, regulated environment testing experience, ISTQB certification, SAFe methodology
Technologies
Python, Playwright, pytest, Behave, GitLab CI/CD, Docker, Kubernetes, Jira, Pact
Responsibilities
Define and evolve test automation framework architecture; design reusable automation patterns for UI, API, and data pipelines; automate AI/ML-specific test cases including LLM output evaluation; integrate tests into GitLab CI/CD pipelines; monitor execution health and manage flaky tests; author BDD scenarios in Gherkin; ensure end-to-end traceability from requirements to test results.
Seniority
Senior, hands-on IC
