Senior Staff AI Engineer, (AI Quality & Test Automation)
Core
Design and lead enterprise AI-driven quality engineering and test automation strategy for regulated GxP systems, using AI agents to test software and validating the AI agents themselves.
Role type
Senior Staff AI Engineer (Quality & Test Automation)
Builds
Enterprise test platforms (Tricentis), multi-agent test workflows, and evaluation frameworks for AI agents.
Domain
Life Sciences / Genomics / Regulated Software (GxP)
Deliverable
production ML models
Required skills
AI agent orchestration, Tricentis Tosca architecture, LLM evaluation frameworks, Model Context Protocol (MCP), CI/CD quality gates, Python/TypeScript/Java/C#, regulated environment testing (GxP), technical leadership.
Preferred skills
Tricentis certifications, AWS ML/AI certifications, life sciences domain expertise, SAP S/4HANA migration testing.
Technologies
Tricentis (Tosca, qTest, NeoLoad, SeaLights, AI Workspace), Claude Agent SDK, Amazon Bedrock, LangGraph, CrewAI, Playwright, GitHub Actions, Azure DevOps.
Responsibilities
Define risk-based test strategy across enterprise apps and AI agents; architect Tricentis platform and agentic testing workflows; build evaluation frameworks for AI agents; integrate agents via MCP; embed quality gates in CI/CD; mentor senior engineers; report quality metrics.
Seniority
Senior Staff, hands-on IC with strategic leadership