Backend Engineer - API
Core
Building the xAI API to serve AI models to developers worldwide with high-throughput, low-latency inference.
Role type
Senior IC backend engineer (API & infrastructure)
Builds
High-throughput inference system, model serving infrastructure, request routing, SDKs, and observability tools.
Domain
AI/ML infrastructure, distributed systems, high-performance computing
Deliverable
production ML models
Required skills
Rust or C++, distributed systems design, service observability, PostgreSQL, Clickhouse, MongoDB
Preferred skills
LLM inference engines (SGLang, TensorRT, vLLM), agent SDKs, Docker, Kubernetes, gRPC
Technologies
Rust, C++, Go, PostgreSQL, Clickhouse, MongoDB, SGLang, TensorRT, vLLM, Docker, Kubernetes, gRPC
Responsibilities
Design and implement reliable, horizontally scalable distributed systems; build and maintain model serving infrastructure; develop SDKs and orchestration frameworks; ensure high availability and efficient scaling.
Seniority
Senior, hands-on IC
