CareerPlanSign in

AI Backend Engineer

USA🌐 Remote💼 Full-time💰 $97,000–$97,000🗓 2026-08-13 → 2026-09-26

Core

Build and run backend systems supporting AI-powered insurance workflows, designing orchestration layers for LLMs and AI-assisted automation.

Role type

Senior IC backend engineer (AI systems)

Builds

Production AI orchestration layers, inference pipelines, and scalable backend services for insurance decisioning and automation.

Domain

Insurance + AI/LLM infrastructure

Deliverable

production ML models | product features | infrastructure

Required skills

Backend engineering, high-throughput low-latency services, distributed systems, system design, API design, observability, LLM integration, caching/batching/streaming, incident response

Preferred skills

Experience with Anthropic/OpenAI models, Node.js, Python, SQL, NoSQL, Docker, Kubernetes

Technologies

Anthropic, OpenAI, LLM APIs, Node.js, Python, SQL, NoSQL, Docker, Kubernetes, observability tools

Responsibilities

Design and implement AI orchestration layers connecting models and business logic; develop inference pipelines for LLM-based automation; optimize latency, throughput, and cost via caching and streaming; define stable service boundaries between backend and ML components; implement observability and incident response workflows; investigate production issues in distributed AI systems; collaborate with frontend, product, and ML teams to deliver features.

Seniority

Senior, hands-on IC

Sourced via devitjobs · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.