Backend Engineer
Core
Design, build, and scale backend systems for a distributed inference platform serving large language models, focusing on latency, throughput, and reliability.
Role type
Senior Backend Engineer (Infrastructure & Distributed Systems)
Builds
Distributed inference platform, APIs, data systems, authentication, and production infrastructure for AI products.
Domain
AI/ML Infrastructure, Cloud Computing, Distributed Systems
Deliverable
production ML models
Required skills
Go, TypeScript/Node.js, Python, PostgreSQL, Redis/Valkey, REST/gRPC, WebSockets/SSE, Docker, AWS, CI/CD, JWT/Auth0
Preferred skills
AI/ML product backend experience, model-serving integration, high-throughput service operations, S3-compatible storage, Stripe, Prometheus/Grafana
Technologies
Go, TypeScript, Node.js, Python, PostgreSQL, Redis, Valkey, gRPC, WebSockets, SSE, Auth0, JWT, Docker, AWS, Stripe, Prometheus, Grafana, GitLab CI/CD
Responsibilities
Design and maintain production backend services; build reliable APIs and service interfaces; optimize data models and caching strategies; implement secure authentication flows; build integrations with AI/inference systems; profile and optimize services for performance and reliability; build automated tests and maintain CI/CD pipelines; monitor production behavior and lead incident investigation.
Seniority
Senior, hands-on IC