QA Engineer
Core
Lead quality strategy for AI-native digital workers, agent workflows, and enterprise platforms, ensuring reliability in high-stakes lending and due-diligence domains.
Role type
Senior QA Engineering Lead (AI/ML)
Builds
AI copilots, autonomous agent workflows, LLM-powered enterprise software, and cloud services.
Domain
Enterprise AI / Lending & Due Diligence
Deliverable
production ML models
Required skills
Test automation (Python/Java/JS), LLM evaluation (hallucination, factuality, bias), Microservices testing, CI/CD integration, Performance testing, Cloud architecture (AWS/Azure)
Preferred skills
RAG pipeline testing, AI observability (ELK, Prometheus), Security & compliance (SOC2, GDPR)
Technologies
Python, Java, JavaScript, Playwright, Selenium, PyTest, Postman, JMeter, k6, AWS, Azure, GitHub Actions, GitLab, Jenkins
Responsibilities
Define end-to-end QA strategy for AI agents and workflows; Lead and mentor QA teams; Develop evaluation systems for LLM accuracy and safety; Architect automation frameworks and integrate into CI/CD; Conduct performance and load testing; Own release sign-off and post-production monitoring.
Seniority
Senior, hands-on IC with leadership