Staff Quality Engineer
Core
Setting technical direction for testing, evaluating, and shipping intelligent AI and agentic systems, including LLM-powered features and non-deterministic workflows.
Role type
Staff Quality Engineer (AI/Agentic Systems)
Builds
AI and agentic products (e.g., Ivy) and the data/tooling supporting them
Domain
Programmatic advertising and marketing technology
Deliverable
production ML models | product features | infrastructure
Required skills
Test automation framework design, API/UI testing, CI/CD pipeline integration, AI system evaluation (LLM output, agent behavior), scalable system design, test case strategy, technical mentorship
Preferred skills
TypeScript, Python, React, OpenAI/Anthropic APIs, self-healing tests, test generation
Technologies
Playwright, Cypress, Jest, Junit, Jenkins, Github Actions, CircleCI, TestRail, React
Responsibilities
Own end-to-end quality strategy for AI pods, design evaluation frameworks for non-deterministic systems, develop scalable automated test suites, establish quality metrics and benchmarks, partner with cross-functional teams on requirements, mentor the QE org, participate in architectural decision-making
Seniority
Staff, hands-on IC with technical leadership
