CareerPlanSign in

AI Automation Engineer

USA💼 Full-time💰 $90,000–$90,000🗓 2026-05-22 → 2026-09-26

Core

Training advanced generative systems and large language models to operate as proactive, multi-step autonomous agents through human feedback and architectural workflow refinement.

Role type

AI Automation Engineer (Human-in-the-loop Training & System Evaluation)

Builds

Proactive, multi-step autonomous agents capable of handling real-world architectural workflows

Domain

Artificial Intelligence / Generative AI / Agentic Systems

Deliverable

production ML models | research

Required skills

Backend engineering, AI automation, complex system integration, multi-stage coordination workflow design, agent-to-tool integration (APIs), persistent state and session tracking, security risk identification (privacy leakage, prompt injection), multi-turn system interaction management

Preferred skills

Experience with modular architecture (parsing, logic, reporting services), hands-on experience connecting agents to live tools (Supabase, Gmail), identifying subtle failure modes in agentic systems

Technologies

Java, JavaScript, Python, SQL

Responsibilities

Provide human feedback to train advanced generative systems and improve AI agents, help large language models learn to operate as proactive, multi-step agents, contribute to teaching systems how to plan, coordinate, and refine complex real-world architectural workflows, support the development of orchestration capabilities for autonomous agents, evaluate and provide detailed feedback on complex system behavior, test agent integrations with live tools and APIs in realistic environments, surface subtle failure modes and interaction risks in agentic systems

Sourced via devitjobs · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.