Senior Staff QA
Core
Architect the overall quality strategy for AI-native digital workers, agent workflows, and enterprise platforms, ensuring reliability in high-stakes domains like lending and due diligence.
Role type
Senior Staff QA Lead (AI/ML focus)
Builds
AI copilots, autonomous agent workflows, LLM outputs, APIs, and cloud services for enterprise clients.
Domain
Enterprise AI / Lending & Due Diligence
Deliverable
production ML models
Required skills
Test automation (Python/Java/JS), LLM evaluation & hallucination detection, CI/CD integration, microservices testing, performance/load testing, release management, synthetic data generation, RCA.
Preferred skills
LLM/RAG pipeline testing, AI observability (ELK/Prometheus/Datadog), security/compliance testing (SOC2/GDPR).
Technologies
Python, Java, JavaScript, Playwright, Selenium, PyTest, Postman, GitHub Actions, GitLab, Jenkins, AWS, GCP, Azure, JMeter, LoadRunner, Gatling, k6, Locust, ELK, Prometheus, Datadog.
Responsibilities
Build end-to-end QA strategy for AI copilots and workflows; lead and mentor QA engineers; develop evaluation systems for LLM accuracy and safety; architect automation frameworks; conduct load/stress testing; own release sign-off and monitor model drift.
Seniority
Senior Staff, hands-on IC with leadership