CareerPlan

Machine Learning Infrastructure Engineer - LLM & Agentic AI

United StatesFull-time$150k–$215k2026-10-28 → 2026-11-10

Core

Design and build scalable infrastructure for Agentic AI frameworks and LLM inference to power Autonomous SOC applications in cybersecurity.

Role type

Senior IC machine learning infrastructure engineer (LLM & Agentic AI)

Builds

Agentic AI frameworks, scalable LLM inference infrastructure, MCP servers, and API services for Autonomous SOC applications

Domain

Cybersecurity / SecOps / Generative AI

Deliverable

production ML models

Required skills

Python, Java, Go, distributed systems, APIs (REST/gRPC), microservices, MLOps, containerization, orchestration, cloud computing

Preferred skills

LLM application development in high-sensitivity domains, Generative AI frameworks (LangChain, LangGraph, AutoGen), observability in ML systems, LLM deployment frameworks (vLLM, llama.cpp), ML platform team experience, SecOps concepts

Technologies

Docker, Kubernetes, vLLM, llama.cpp, LangChain, LangGraph, AutoGen, REST, gRPC

Responsibilities

Design and build Agentic AI frameworks to orchestrate LLM-based agents; Develop scalable LLM inference infrastructure; Develop MCP servers for Open XDR platform integration; Develop supporting API services for agent operations; Collaborate with researchers and engineers to align infrastructure with product needs

Seniority

Senior, hands-on IC