Senior Software Engineer, Backend
Core
Design and build scalable gateway, runtime, and evaluation services for AI workloads, including identity, quota, routing, and governance controls.
Role type
Senior IC backend software engineer (AI infrastructure)
Builds
Scalable gateway, runtime, and evaluation services for AI/LLM workloads
Domain
Artificial Intelligence / Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, Kotlin, AWS, MySQL, Kubernetes, LLM inference APIs, MCP, tool calling, agent runtimes, distributed systems design, system metrics and alerting, code review standards
Preferred skills
Technical writing, public speaking, mentoring engineers
Technologies
Python, Kotlin, AWS, MySQL, Kubernetes
Responsibilities
Design and build scalable gateway, runtime, and evaluation services for AI workloads; Develop identity, quota, routing, caching, failover, cost attribution, and governance controls for AI systems; Partner with security, infrastructure, and product engineering teams on agentic workload guardrails; Create and monitor system metrics, alerts, runbooks, and operational health practices; Improve code review and design standards and mentor engineers
Seniority
Senior, hands-on IC
