Staff / Principal Software Engineer - USA
Core
Building scalable backend systems for a real-time AI platform that powers voice models (TTS/STT) and routes requests across 200+ LLMs for consumer applications.
Role type
Staff/Principal Backend Engineer (IC)
Builds
Intelligent routing layer, real-time API, model services, and infrastructure for AI platformization
Domain
AI/ML infrastructure, Real-time systems, Cloud services
Deliverable
production ML models | product features | infrastructure
Required skills
Statically typed backend languages (Go, Python, C++, Rust), High-throughput cloud services, Relational databases, Caching, Pubsub/queues, Data pipelines
Preferred skills
API gateways, Multi-provider orchestration, Analytics/timeseries databases, OpenTelemetry
Technologies
Go, Python, C++, Rust, PostgreSQL, MySQL, Redis, Memcached, Flink, Beam, ClickHouse, Timescale, InfluxDB, OpenTelemetry
Responsibilities
Design systems for multi-provider failover and cost/latency-based routing, Develop and deploy cloud-based services handling hundreds of qps, Collaborate with ML teams on real-time AI capabilities, Drive system improvements and technical standards
Seniority
Staff/Principal, hands-on IC
