AI Platform Senior Engineer, QA
Core
Lead quality assurance for agent-driven platforms and AI models, validating intelligent agents, non-deterministic outputs, and cross-product workflows.
Role type
Senior IC QA Engineer (Agentic AI & Automation)
Builds
Enterprise AI Trust & Validation Framework, automation frameworks, and test utilities for AI systems.
Domain
Artificial Intelligence / Agentic Systems / Quality Engineering
Deliverable
production ML models
Required skills
Python, JavaScript/TypeScript, Pytest, Playwright, API testing, Performance testing, Non-deterministic system testing, LLM evaluation, CI/CD integration
Preferred skills
Agent frameworks (LangChain, AutoGen, CrewAI), RAG systems, Vector databases, MLOps, AWS, Statistical validation, NLP evaluation, Docker/Kubernetes
Technologies
Python, JavaScript, TypeScript, Pytest, Playwright, Postman, K6, AWS, GitHub Actions, Jenkins, GitLab, Docker, Kubernetes, LangChain, AutoGen, CrewAI
Responsibilities
Test multi-agent workflows and orchestration layers; Design and maintain automation frameworks for UI, APIs, and agent pipelines; Validate in-house AI/ML models and inference pipelines; Perform API testing and load/stress testing; Analyze business requirements and design test strategies for agentic systems; Track defects and drive continuous improvement in QA processes.
Seniority
Senior, hands-on IC