ML Engineer
Core
Build a unified API gateway for LLMs that transforms requests between OpenAI/Anthropic specs and various provider formats.
Role type
ML Engineer (LLM Infrastructure)
Builds
Provider-agnostic unification functionality, session management, and interoperability layers for LLMs, MCPs, and Agents.
Domain
AI Infrastructure / LLM APIs
Deliverable
production ML models
Required skills
Python, LLM APIs, FastAPI, System Design, API Specification Knowledge (OpenAI/Anthropic), MCP Auth flows
Preferred skills
Open source contribution, User engagement, Small team collaboration
Technologies
Python, FastAPI, Redis, Postgres
Responsibilities
Write transformations to convert API requests between OpenAI/Anthropic specs and provider formats, Design system features at the gateway level, Build interoperability layers for LLMs, MCPs, and Agents, Support millions of users via the Python SDK
Seniority
Junior to Mid-level, hands-on IC
