CareerPlanSign in

Senior AI Engineer (LLM & Agent Systems) — Platform

New York, New York, United States💼 Full-time🗓 2026-08-20 → 2026-09-11

Core

Designing and scaling reusable AI-driven workflows and platform components powered by large language models and autonomous agents to enable internal teams to rapidly deploy intelligent systems.

Role type

Senior IC platform engineer (LLM & Agent Systems)

Builds

Reusable agent-based workflows, shared APIs, evaluation pipelines, and monitoring systems for AI outputs

Domain

Artificial Intelligence / Large Language Models / Autonomous Agents / Platform Infrastructure

Deliverable

production ML models

Required skills

Distributed systems design, LLM-based system development, system reliability engineering, observability, cost optimization, API design, orchestration patterns, model evaluation, testing framework design

Preferred skills

Retrieval systems, embeddings, context management pipelines, regulated environment experience

Technologies

Large Language Models, Autonomous Agents, Orchestration Frameworks, Testing Frameworks, Monitoring Systems

Responsibilities

Design and implement orchestration patterns for LLM-powered agents; Evaluate and select models, tools, and providers based on performance, cost, and reliability; Build testing frameworks, evaluation pipelines, and monitoring systems for AI outputs; Implement safeguards, fallback mechanisms, and cost optimization strategies; Collaborate with platform and backend engineers to integrate AI capabilities into scalable services; Identify repeatable patterns across projects and convert them into reusable platform features

Seniority

Senior, hands-on IC

Sourced via zohorecruit · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.