Senior Agents Platform Engineer (x/f/m)
Core
Build the foundational platform enabling feature teams to deploy production-grade, secure AI agents for healthcare applications like Consultation Assistants and Health Companions.
Role type
Senior Platform Engineer (LLM Agents & Infrastructure)
Builds
A shared agent runtime, unified GenAI gateway, and observability/evaluation infrastructure for AI agents.
Domain
Healthcare technology / Generative AI / Cloud Infrastructure
Deliverable
production ML models
Required skills
LLM-based agent system design, agent orchestration (Google ADK), GenAI gateway management (LiteLLM), Kubernetes, Python, infrastructure reliability (SLOs, incident response), feature flagging, observability.
Preferred skills
Kubernetes-native abstractions (CRDs/operators), durable stateful execution engines (Temporal), regulated environment experience (GDPR, HDS), long-term memory/RAG pipelines.
Technologies
Python, TypeScript, Go, LiteLLM, vLLM, Google ADK, Kubernetes (GKE/EKS), Terraform, MLflow, Braintrust, Datadog, Flagd, MCP, A2A, AG-UI.
Responsibilities
Design agent manifest and registry, manage GenAI gateway routing and failover, operate streaming agent interaction infrastructure, build progressive rollout systems, ensure platform reliability and SLOs, build observability and evaluation layers.
Seniority
Senior, hands-on IC
