CareerPlanSign in

Lead Machine Learning Engineer

New York💼 Full-time🗓 2026-02-04 → 2026-09-26

Core

Design and develop ML evaluation systems for agentic and LLM-based architectures, translating research into production-grade systems to serve customers at scale.

Role type

Lead Machine Learning Engineer (NLP/LLM)

Builds

Production-grade agentic AI systems and evaluation frameworks

Domain

Artificial Intelligence / Natural Language Processing / Large Language Models

Deliverable

production ML models

Required skills

NLP, LLM-based systems, agentic systems, Python, AWS, Kubernetes, Docker, software architecture, technical mentorship

Preferred skills

Building and evaluating agentic systems at scale, LLM-centric services (inference, orchestration, evaluation, monitoring), large-scale ML experimentation, model optimization for inference, CI/CD, Kafka, Athena

Technologies

Python, AWS, Kubernetes, Docker, Kafka, Athena, CI/CD

Responsibilities

Design and develop ML evaluation systems for agentic and LLM-based architectures; Translate research ideas into production-grade ML systems; Partner with Research, Product, and Platform teams to productize experiments; Mentor and support other engineers through design reviews and knowledge sharing.

Seniority

Senior, hands-on IC with mentorship responsibilities

Sourced via lever · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.