QA Engineer
Core
Build and own end-to-end QA strategy for AI copilots, workflows, and enterprise deployments, including evaluation systems for LLM accuracy, hallucination detection, and safety.
Role type
Senior IC QA Engineer (AI/ML)
Builds
AI software and platform features, including LLM operations, RAG pipelines, and autonomous agents
Domain
Artificial Intelligence / Machine Learning / Cloud Infrastructure
Deliverable
production ML models | product features
Required skills
Test automation frameworks, Python, Java, JavaScript, microservice architectures, distributed cloud systems, APIs, LLM operations, RAG, vector stores, Playwright, Selenium, PyTest, Postman, Azure, AWS, load/stress testing, root-cause analysis, CI/CD integration
Preferred skills
Testing LLMs, RAG pipelines, autonomous AI agents, AI observability, logging, monitoring stacks (ELK, Prometheus, Datadog), security testing, performance/load testing, compliance (SOC 2, GDPR)
Technologies
Playwright, Selenium, PyTest, Postman, Azure, AWS, ELK, Prometheus, Datadog
Responsibilities
Lead and scale a team of QA engineers and automation specialists; Define quality gates and release-readiness standards for AI software; Develop evaluation systems for LLM accuracy and safety; Create synthetic datasets and scenario-based tests; Architect and manage automation frameworks integrated into CI/CD pipelines; Conduct load, stress, spike, endurance, and soak testing; Collaborate with DevOps and MLOps teams to monitor model drift and performance anomalies
Seniority
Senior, hands-on IC
