CareerPlan

Senior Machine Learning Engineer, AI Agent Platform

New York City, NYFull-time$105k–$230k2026-06-05 → 2026-11-11
Based in United StatesVisa sponsorship offered

Core

Design, develop, and deploy systems for GEICO's virtual assistant platform and multi-tenant AI agent services to support internal associates and policyholders.

Role type

Senior IC machine learning engineer (AI agent platform)

Builds

Multi-tenant services for building, testing, simulation, deployment, and hosting of LLM-based AI agents; enterprise AI agent skill ecosystems; context engineering systems; guardrail systems.

Domain

Insurance / Generative AI / AI Agents

Deliverable

production ML models

Required skills

Python, Java, C++, C#, LLM platform design, RAG pipelines, context management, guardrail implementation, Kubernetes, CI/CD, GPU infrastructure, distributed processing (Spark, Ray), workflow management (Airflow, Temporal), search engines (OpenSearch, Milvus), data warehouses (Snowflake), streaming (Kafka), NoSQL (Cassandra), relational databases (PostgreSQL), memory management (Redis/Valkey), multi-agent orchestration (LangGraph, AutoGen, CrewAI), LLM observability (LangSmith, Langfuse).

Preferred skills

Conversational experience design, agentic workflows, AI agent harness infrastructure, AI agent skill systems, LLM guardrails.

Responsibilities

Develop services for authoring, publishing, discovering, and versioning reusable skill packages; build AI agent harness components for tool dispatch and session state; implement context engineering systems for memory management and RAG; implement guardrail components for input validation and PII detection; collaborate with cross-functional teams to define project scope; mentor junior engineers.

Seniority

Senior, hands-on IC