Senior Backend Engineer (AI Platform)
Core
Build the LLM infrastructure layer that governs access, routing, metering, and guardrails for hosted and self-hosted models, serving enterprise clients in climate and sustainability.
Role type
Senior Backend Engineer (LLM Infrastructure)
Builds
LLM gateway, retrieval/knowledge service, async execution framework, and evaluation harnesses
Domain
AI/ML infrastructure, Climate & Sustainability
Deliverable
production ML models
Required skills
Async Python, Postgres, Redis, Distributed systems, API design, LLM gateway engineering, Retrieval engineering, Cost accounting, Evaluation harnesses
Preferred skills
Energy/Climate domain experience, Startup/Enterprise environment experience
Technologies
Python 3.12+, FastAPI/Starlette, Pydantic v2, asyncpg, SQLAlchemy, pgvector, OpenTelemetry, Celery/Dramatiq/Prefect
Responsibilities
Own the LLM gateway (routing, metering, guardrails); Manage retrieval and knowledge service; Build evaluation harnesses; Own the async framework; Design authorization and token hierarchies; Define success metrics for shipped services
Seniority
Senior, hands-on IC