AI Quality Engineer
Core
Providing human feedback to train advanced generative systems and LLMs that operate as proactive, multi-step agents.
Role type
AI Quality Engineer (Human-in-the-loop training)
Builds
Smarter orchestration, stronger reasoning, and better real-world execution for autonomous agents
Domain
Artificial Intelligence / Large Language Models / Agent Orchestration
Deliverable
production ML models
Required skills
backend engineering, AI automation, complex system integration, modular software design, multi-turn system interaction management, multi-stage coordination workflow design, live tool and API integration, persistent state and session tracking, security vulnerability identification (privacy leakage, authority escalation, prompt injection)
Preferred skills
proficiency in at least two major programming languages (Python, JavaScript, Go, Java), SQL database experience, experience with live non-simulated environments
Technologies
Java, JavaScript, Python, SQL, Supabase, Gmail, MEMORY.md
Responsibilities
Provide human feedback to improve AI agent performance, analyze system behavior in live environments, evaluate agent interactions for security weaknesses and prompt-injection vulnerabilities, contribute to designing and refining complex real-world architectural workflows, support creation of orchestration-heavy solutions requiring data collection and structured output
Seniority
Mid-level (2+ years experience)