Senior Software Engineer, Backend (AI)
Core
Architecting, crafting, and maintaining internal tooling systems, frameworks, and platforms that elevate the core of business operations, specifically building the AI Gateway (GrabGPT Gateway) — Grab's unified LLM API gateway and single integration point for all AI initiatives.
Role type
Senior Software Engineer, Backend (AI)
Builds
Scalable, high-throughput gateway services, platform capabilities for model routing, tiered capacity management, chargeback, and observability for a service in the critical path of all LLM traffic.
Domain
Artificial Intelligence / Large Language Models (LLM) / Backend Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Go (Golang), Python, LLMs (Large Language Models), LangChain, LangGraph, AWS, Kubernetes, CI/CD pipelines, distributed systems, multi-threading, relational databases (MySQL, PostgreSQL, Oracle), automated testing, technical documentation.
Preferred skills
None stated.
Technologies
Go, Python, LangChain, LangGraph, AWS, Kubernetes, Redis, PostgreSQL, MySQL, Oracle, EKS, SSE streaming, OIDC, workload-identity.
Responsibilities
Manage gateway features end-to-end including provider integrations, unified API endpoints, model onboarding, API key and identity management, rate limiting, tiering, and cost tracking. Design multi-provider LLM routing systems translating a unified API surface into provider-native formats with SSE streaming and automatic fallback. Build and operate reliability and governance layers including distributed rate limiting, capacity isolation, authentication, and token-level usage logging. Manage CI/CD and cloud resources including Kubernetes deployments and database migrations. Champion test-driven development, write tests first, mentor junior engineers, and foster a platform-thinking culture. Ensure system reliability for a Tier-critical service by participating in on-call rotations, managing provider capacity and quota incidents, conducting root cause analysis, and leading post-mortems.
Seniority
Senior, hands-on IC