Backend Engineer - London
Core
Human-in-the-loop training and evaluation of autonomous AI agents and LLMs to improve their planning, coordination, and optimization of complex real-world workflows.
Role type
AI Backend Engineer (Human Feedback & Evaluation)
Builds
Proactive, multi-step autonomous agents and orchestration systems for real-world architectural workflows
Domain
Applied AI / Generative AI / Autonomous Agents
Deliverable
production ML models
Required skills
Backend engineering, AI automation, complex system integration, multi-step system interactions, SQL databases, API integration, privacy/security awareness, prompt injection detection, session tracking, technical feedback on system behavior
Preferred skills
Experience with multi-stage coordination workflows, connecting agents to live tools (Supabase, Gmail, APIs), implementing persistent state
Technologies
Java, JavaScript, Python, SQL
Responsibilities
Provide human feedback on AI agent behavior to train LLMs, evaluate technical system behavior and deliver detailed feedback, support development of proactive multi-step agents, work on live orchestration tasks involving data collection and reasoning, collaborate with AI organizations to improve autonomous agent function
Seniority
Mid-level (2+ years experience)