Staff / Principal Software Engineer - Canada
Core
Building scalable backend systems for a global AI platform that powers realtime voice models (TTS, STT) and intelligent routing for hundreds of LLMs.
Role type
Staff/Principal Backend Software Engineer
Builds
Inworld Router (multi-provider LLM orchestration), Realtime API, TTS/STT model services, and platform infrastructure
Domain
Artificial Intelligence / Realtime Voice Systems / Cloud Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
statically typed backend languages (Go, Python, C++, Rust), high-throughput cloud service deployment, relational databases (PostgreSQL, MySQL), caching (Redis, Memcached), pubsub/queues, data pipelines (Flink, Beam), cloud storage
Preferred skills
API gateway/routing/proxy layer design, multi-provider orchestration, analytics/timeseries databases (ClickHouse, Timescale, InfluxDB), OpenTelemetry, C++
Technologies
Go, Python, C++, Rust, PostgreSQL, MySQL, Redis, Memcached, Flink, Beam, ClickHouse, Timescale, InfluxDB, OpenTelemetry
Responsibilities
Design and own core systems for multi-provider failover, cost/latency-based routing, and real-time observability at massive scale; develop API-based model services including instant voice cloning; build platformization projects including system-wide billing and development tool integration; collaborate with ML teams to integrate learning and adaptability capabilities
Seniority
Staff/Principal, hands-on IC
