Platform Engineer - AI Engineering
Core
Build and manage centralized API gateways and management planes to govern, route, and secure LLM traffic and self-hosted models.
Role type
Senior IC platform engineer (AI infrastructure)
Builds
Centralized AI management plane, API gateways, usage dashboards, and automated friction mechanisms
Domain
Cloud infrastructure + Large Language Model (LLM) ecosystem
Deliverable
production ML models | infrastructure
Required skills
Go, Python, API design, API gateway configuration, distributed system networking, cloud engineering
Preferred skills
Experience with Azure OpenAI, model deployment, proxy configuration
Technologies
Go, Python, Azure OpenAI, API gateways
Responsibilities
Configure multi-engine API gateways with dynamic routing and rate limits for LLM requests; Migrate firm-wide tools into the centralized management plane; Manage AI services in enterprise landing zones including model deployments; Write code for usage dashboard synchronization and automated alerts; Register and route self-hosted on-premise models within AI gateways
Seniority
Senior, hands-on IC
