CareerPlanGet AI match score →

Senior Machine Learning Engineer, AI Agent Platform

New York City, NY💼 Full-time💰 $105,000–$105,000🗓 2026-06-05 → 2026-07-31

Core

Design, develop, and deploy high-performance Generative AI systems and platforms powering virtual assistants for internal associates and policyholders.

Role type

Senior IC Machine Learning Engineer (AI Agent Platform)

Builds

Multi-tenant services for building, testing, simulation, deployment, and hosting of LLM-based AI agents.

Domain

Insurance / Generative AI / AI Agents

Deliverable

production ML models

Required skills

Python, Java, C++, C#, LLM platform design, open-source/cloud-agnostic components, end-to-end software development lifecycles, AI/ML model evaluation and observability, GPU infrastructure management

Preferred skills

Conversational experiences and agentic workflows, AI agent harness infrastructure, AI agent skill systems, multi-agent orchestration frameworks, LLM observability platforms, AI agent guardrails

Technologies

OpenSearch, Milvus, Snowflake, Kafka, PostgreSQL, Cassandra, Spark, Ray, Airflow, Temporal, Redis/Valkey, LangGraph, AutoGen, CrewAI, LangSmith, Langfuse

Responsibilities

Develop services for authoring, publishing, discovering, and versioning reusable skill packages; Build and maintain AI agent harness components for tool dispatch and context management; Implement context engineering systems for memory management and RAG pipelines; Implement guardrail components for input validation and output verification; Collaborate with cross-functional teams to define project scope and prioritize backlogs; Mentor junior engineers via code reviews and design sessions

Seniority

Senior, hands-on IC

Sourced via workday · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Workday ↗