CareerPlan

AI Platform Engineer

RemoteFull-time2026-11-17 → 2026-11-19
Hybrid

Core

Build a central AI services platform (model gateway, RAG-as-a-service, evals, guardrails) consumed by every product line to deliver AI features to real customers.

Role type

Senior IC AI Platform Engineer (LLMOps/Backend)

Builds

Central AI platform services, shared libraries, SDKs, and integration patterns for product teams.

Domain

B2B SaaS / Financial Operations / AI Infrastructure

Deliverable

production ML models

Required skills

Python, Go or Java, distributed systems, MLOps/LLMOps, observability tools (LangSmith, Langfuse, etc.), LLM ecosystem (OpenAI/Anthropic APIs, LangChain, vector DBs), cloud-native (Kubernetes, Terraform), multi-tenant architecture, AI security fundamentals.

Preferred skills

ERP/procurement domain experience, founding platform team experience, open-source AI/ML contributions, agent frameworks (LangGraph, AutoGen).

Technologies

Python, Go, Java, Kubernetes, Terraform, LangChain, LlamaIndex, OpenAI, Anthropic, LangSmith, Langfuse, Arize, Braintrust, vector databases, service mesh.

Responsibilities

Design and build production AI services with clear API contracts and SLOs; implement RAG-as-a-service, prompt engineering, and guardrails; own on-call rotation and incident response; partner with product leads to onboard AI features; set operational standards for observability and cost tagging; contribute to architecture decisions and AI security posture.

Seniority

Senior, hands-on IC