Senior Software Engineer - Dev Platform
Core
Build and operate the AI Gateway, a company-wide LLM gateway providing self-service access to models from providers like Anthropic, OpenAI, and Google with usage visibility, cost controls, and routing.
Role type
Senior IC backend/platform software engineer (LLM infrastructure)
Builds
Internal developer platform (AI Gateway) for Kraken engineers
Domain
Fintech / Crypto / LLM Infrastructure
Deliverable
production ML models
Required skills
Backend engineering (Rust, Python, TypeScript), API design, distributed systems, LLM API patterns, observability, CI/CD, Kubernetes, cloud platforms
Preferred skills
API gateway experience, LLM-powered system building, auth/authorization patterns (OAuth, OIDC, RBAC), open-source contributions
Technologies
Rust, Python, TypeScript, Kubernetes, Anthropic, OpenAI, Google
Responsibilities
Build and extend the AI Gateway with new integrations and routing policies; Design APIs, SDKs, and self-service tooling; Migrate LLM workloads to the gateway; Implement access control, key management, and audit logging; Instrument the gateway for latency, error, and cost tracking; Own features end-to-end from design to production; Support internal users with documentation and debugging
Seniority
Senior, hands-on IC
