CareerPlanSign in

AI Agent Engineer

USA💼 Full-time💰 $90,000–$90,000🗓 2026-05-21 → 2026-09-26

Core

Train advanced generative AI systems and LLMs by providing human feedback to improve autonomous agents' ability to plan, coordinate, and optimize complex workflows.

Role type

AI Agent Engineer (Human-in-the-loop training & evaluation)

Builds

Proactive, multi-step autonomous agents and orchestration-focused workflows

Domain

Generative AI / Large Language Models / Autonomous Agents

Deliverable

production ML models

Required skills

Backend engineering, AI automation, complex system integration, modular architecture design, multi-turn system interaction management, multi-stage coordination workflows, live tool integrations, persistent state handling, security issue identification (privacy leakage, authority escalation, prompt injection)

Preferred skills

Proficiency in multiple major programming languages (Python, JavaScript, Go, Java), SQL database experience, practical experience in live real-world environments

Technologies

Java, JavaScript, Python, SQL

Responsibilities

Provide human feedback to train LLMs acting as autonomous agents, evaluate system behavior in realistic environments to identify functional or security issues, deliver technical observations to improve agent performance and reliability, collaborate on orchestration tasks and real-world integration challenges

Seniority

Mid-level (2+ years experience)

Sourced via devitjobs · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.