CareerPlanSign in

Job

💼 Full-time🗓 2026-09-26

Core

Building shared production infrastructure for LLMs and AI agents to increase engineering leverage across the development lifecycle.

Role type

Senior IC Platform Engineer (AI Infrastructure)

Builds

Secure model access, MCP infrastructure, agent runtime/orchestration, observability, and evaluation frameworks for AI workloads.

Domain

AI/ML Infrastructure, Cloud Platforms, Distributed Systems

Deliverable

production ML models | infrastructure

Required skills

Backend/Platform service design, Distributed systems, Cloud platforms (GCP/AWS/Azure), Kubernetes, CI/CD, Observability, Auth/Authorization/Secrets management, System architecture

Preferred skills

LLM applications, Agentic systems, RAG, MCP, Model gateways, Vector databases, Semantic search, Internal developer platforms, Python (FastAPI), Helm, Kubernetes operators

Responsibilities

Build and operate core AI infrastructure including model access and provider abstraction; Build managed MCP infrastructure with access control and auditability; Design runtime and orchestration capabilities for production AI agents; Build observability, evaluation, and security guardrails for AI workloads; Collaborate with teams to turn AI use cases into reusable platform capabilities; Own systems end-to-end from architecture to production support.

Seniority

Senior, hands-on IC

Sourced via cypruswork · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.