CareerPlan

GenAI Platform Engineer – LLM Gateway

India - RemoteFull-time2026-11-17 → 2026-11-18

Core

Build and operate the enterprise GenAI Gateway, a governed entry point for LLMs providing multi-provider access, routing, security, and observability for Pfizer's internal applications.

Role type

Senior individual contributor platform engineer (GenAI/LLM)

Builds

Enterprise LLM gateway, agentic tooling (MCP, agent registries), and self-service developer portals

Domain

Healthcare / Generative AI Platform Engineering

Deliverable

production ML models

Required skills

Python (async, FastAPI), LLM provider APIs (OpenAI, Azure, Bedrock), AWS (containers, CI/CD), observability (OpenTelemetry, Langfuse), security (OAuth, RBAC, secret management), root-cause analysis

Preferred skills

AI/LLM gateway experience, open-source maintenance, agentic AI patterns (LangGraph, RAG), Kubernetes, Terraform, React/TypeScript, AWS certification

Technologies

Python, FastAPI, Docker, GitHub Actions, OpenTelemetry, Langfuse, AWS, Kubernetes, Terraform, React, TypeScript, MCP, LangGraph, LangChain

Responsibilities

Design and build multi-provider model access and routing features; integrate agentic capabilities with security controls; maintain open-source foundations and upstream contributions; build automated quality gates and CI/CD pipelines; perform root-cause analysis of production incidents; evaluate emerging GenAI capabilities and create reusable assets

Seniority

Senior, hands-on IC