CareerPlan

Staff MaaS Backend Engineer

San Jose, CAFull-time2026-11-04 → 2026-11-16

Core

Re-architect a Model-as-a-Service (MaaS) system into a commercial, globally distributed, multi-tenant token service supporting millions of monthly active users and high token throughput.

Role type

Staff Backend Engineer (LLM Infrastructure)

Builds

Globally distributed MaaS platform, inference gateway, multi-tenant billing ledger, and observability stack.

Domain

AI/ML Infrastructure, Cloud Computing, Bitcoin Mining

Deliverable

production ML models

Required skills

Go, Kubernetes, Distributed Systems, API Design, Performance Optimization, Multi-tenant Architecture, Billing Systems, Observability (OpenTelemetry), Security (AuthN/AuthZ)

Preferred skills

LLM Serving (KV caching, streaming), Brownfield Migration, SLO Management, GPU-aware Scheduling

Technologies

Go, Kubernetes, Envoy, PostgreSQL, Redis, Kafka, OpenTelemetry

Responsibilities

Co-own end-to-end MaaS system design and technical trade-offs; Optimize token throughput and latency (TTFT) at p95/p99 levels; Enforce multi-tenant isolation and fail-closed authorization; Build idempotent, exactly-once token metering and billing systems; Execute zero-regression, incremental platform upgrades; Define and defend strict Service Level Objectives (SLOs).

Seniority

Staff, hands-on IC with architectural leadership