CareerPlan

Senior QA Engineer

BerlinFull-time2026-10-14 → 2026-11-11

Core

A senior, hands-on engineering role responsible for creating measurable confidence in both the conventional software platform and the agentic AI workflows behind it, turning quality from manual judgment into an automated, evidence-based release process.

Role type

Senior SDET / Quality Engineering Lead (Software + Agentic AI)

Builds

Automated UI and API suites, integration and end-to-end scenarios, version-controlled AI evaluation datasets, agent-workflow graders, CI/CD quality gates, test and evaluation reports, release-readiness dashboards.

Domain

SaaS platform, Agentic AI, LLM workflows, Procurement/Supply-chain systems

Required skills

Test strategy definition, TypeScript, Python, Playwright, pytest, API and integration testing, SQL, CI/CD, asynchronous and distributed systems testing, production debugging, judgment on ambiguous requirements.

Preferred skills

LLM and agent evaluations, trace-based debugging, model-based grading, prompt-injection and adversarial testing, multi-tenant SaaS platforms, email and document processing, procurement/manufacturing/supply-chain systems.

Technologies

React, Playwright, pytest, SQL, CI/CD, LLMs, Agents

Responsibilities

Define and own the testing strategy across the platform; build automated coverage for React web app, backend APIs, auth, database, third-party integrations, and end-to-end RFQ/quotation journeys; perform API and integration testing including error handling, idempotency, and data consistency; conduct AI and LLM evaluations using versioned datasets and statistical comparison; test agent workflows for tool selection, argument validity, and business outcome correctness; utilize controlled AI testing agents to generate scenarios and reproduce defects; define and maintain release readiness criteria and communicate risk; investigate production failures across layers to create reproducible test cases.