QA Engineer (AI Applications)
Core
Providing human feedback to train advanced generative systems and multi-step AI agents in live environments.
Role type
Senior QA Engineer (AI Applications)
Builds
Production-ready AI agent systems with complex orchestration workflows
Domain
Generative AI / Autonomous Agents
Deliverable
production ML models
Required skills
Backend engineering, AI automation, complex system integration, Python, JavaScript, Go, Java, SQL, live environment testing, multi-turn system interaction analysis, privacy leakage detection, authority escalation detection, indirect prompt injection detection, persistent state tracking, session monitoring
Preferred skills
Designing multi-stage coordination workflows, integrating agents with live tools and APIs (Supabase, Gmail), software engineering orchestration
Technologies
Java, JavaScript, Python, SQL
Responsibilities
Provide human feedback on AI agents to train large language models, evaluate system behavior in live environments, surface nuanced failures affecting safety and reliability, collaborate with AI organizations to optimize autonomous agent performance, apply software engineering expertise to strengthen agent capabilities
Seniority
Mid-Senior, hands-on IC