GenAI Platform Engineer – LLM Gateway
Core
Build and operate the enterprise GenAI Gateway, a governed entry point for LLMs providing multi-provider access, routing, security, and observability for Pfizer's internal applications.
Role type
Senior individual contributor platform engineer (GenAI/LLM)
Builds
Enterprise LLM gateway, agentic tooling (MCP, agent registries), and self-service developer portals
Domain
Healthcare / Generative AI Platform Engineering
Deliverable
production ML models
Required skills
Python (async, FastAPI), LLM provider APIs (OpenAI, Azure, Bedrock), AWS (containers, CI/CD), observability (OpenTelemetry, Langfuse), security (OAuth, RBAC, secret management), root-cause analysis
Preferred skills
AI/LLM gateway experience, open-source maintenance, agentic AI patterns (LangGraph, RAG), Kubernetes, Terraform, React/TypeScript, AWS certification
Technologies
Python, FastAPI, Docker, GitHub Actions, OpenTelemetry, Langfuse, AWS, Kubernetes, Terraform, React, TypeScript, MCP, LangGraph, LangChain
Responsibilities
Design and build multi-provider model access and routing features; integrate agentic capabilities with security controls; maintain open-source foundations and upstream contributions; build automated quality gates and CI/CD pipelines; perform root-cause analysis of production incidents; evaluate emerging GenAI capabilities and create reusable assets
Seniority
Senior, hands-on IC