Principal QA Automation Engineer w/ AI experience
Core
Design, develop, and maintain robust test automation frameworks for AI-driven applications within AWS cloud environments, ensuring quality for intelligent, adaptive systems.
Role type
Principal QA Automation Engineer (AI/ML)
Builds
End-to-end test automation frameworks and CI/CD integration for AI-infused features
Domain
Technology services / AI & Machine Learning / Cloud Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Cypress, TypeScript, JavaScript, Python, AWS services, CI/CD pipelines, Git, Docker, AI model validation, non-deterministic testing
Preferred skills
AI model evaluation and monitoring, API/microservices testing, statistical/heuristic testing approaches, open-source contributions
Technologies
Cypress, TypeScript, JavaScript, Python, AWS (Lambda, S3, SQS, CloudWatch, ECS/EKS), GitHub Actions, Jenkins, CircleCI, Docker, SageMaker, MLflow, LangChain
Responsibilities
Lead design and implementation of end-to-end test automation frameworks using Cypress with TypeScript; Define quality strategies for applications with AI/ML components; Collaborate with engineering, DevOps, and AI/ML teams; Build and scale testing strategies for threaded AI applications; Integrate automated tests into CI/CD pipelines; Mentor mid- and senior-level QA engineers; Evaluate and introduce new tools to improve test coverage; Participate in architectural discussions; Analyze test results and communicate risk to stakeholders
Seniority
Principal, hands-on leadership & mentorship
