CareerPlanSign in

Senior & Staff Backend Engineer, AI Systems

New York, New York, United States💼 Full-time🗓 2026-06-19 → 2026-09-11

Core

Build internal tooling, agent orchestration systems, and evaluation frameworks for AI-native products that enable solo operators to automate complex workflows.

Role type

Senior / Staff Backend Engineer (Applied AI Systems)

Builds

Embedded AI copilot, secure AI agent tooling, orchestration layers, and observability systems for non-deterministic AI behavior.

Domain

Applied AI, Backend Engineering, Distributed Systems

Deliverable

production ML models | product features | infrastructure

Required skills

Python, modern web frameworks, API design, distributed systems, relational databases, ORMs, system reliability engineering, performance optimization

Preferred skills

LLM-powered feature development, agent workflows, structured outputs, streaming, retrieval systems, AI evaluation frameworks, asynchronous processing, Kubernetes, AWS

Technologies

Python, AWS, Kubernetes, LLM SDKs, Agent Frameworks

Responsibilities

Design and build internal tooling for secure AI system interaction; develop agent orchestration systems with multi-step workflows and retries; improve system reliability via evaluation frameworks and tracing; optimize performance and latency for real-time AI interactions; collaborate across backend, platform, and frontend layers.

Seniority

Senior / Staff, hands-on IC with strategic scope

Sourced via zohorecruit · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.