ML-QA Engineer
Core
QA Engineer specializing in automated testing for AI-driven, agentic applications that plan, act, and adapt.
Role type
Senior IC QA Automation Engineer (AI/Agentic Systems)
Builds
Automated test frameworks, CI/CD integration, and validation tools for intelligent negotiation platforms.
Domain
SaaS / Procurement Intelligence / AI & Game Theory
Deliverable
production ML models | product features
Required skills
Python, test automation frameworks (PyTest, Selenium, Playwright), CI/CD integration, API testing (REST, Postman, Swagger), chaos testing, data pipeline validation, root cause analysis, scenario-based testing.
Preferred skills
Observability tools (Datadog, Grafana, AWS CloudWatch), microservices/serverless testing, performance testing (Locust, k6), security guardrail testing.
Responsibilities
Design and maintain automated test frameworks for agentic applications; integrate tests into CI/CD pipelines; verify observability and explainability of agent behavior; perform chaos testing to validate decision-making under uncertainty; test human-in-the-loop workflows; conduct root cause analysis of production issues.
Seniority
Senior, hands-on IC