AI Quality and Automation Specialist
Core
Building automated testing and evaluation frameworks for AI agents and critical workflows to ensure reliability and quality.
Role type
Senior IC AI Quality and Automation Engineer
Builds
Automated test suites, evaluation metrics, and CI/CD quality gates for AI agents
Domain
Social gaming, AI agents, test automation
Deliverable
production ML models
Required skills
Test automation, TypeScript, Python, API testing, CI/CD, Git, AI evaluation, bug reproduction, root cause analysis
Preferred skills
Agentic browser testing, LLM evaluation frameworks, Supabase, Vercel, GCP
Responsibilities
Build and maintain API, integration, and end-to-end regression tests; Evaluate AI agents on task completion, response quality, and tool use; Integrate quality checks into CI/CD pipelines; Use AI agents to explore workflows and generate tests; Share tools and methods with the AI team and central QA department