Tokens-as-a-Service (Taas) Software Engineer
Core
Build systems to convert large-scale infrastructure capacity into measurable, reliable token throughput for OpenAI workloads.
Role type
Senior IC systems engineer (infrastructure & tokenomics)
Builds
Systems and tooling for measuring, monitoring, and optimizing token throughput across first-party and partner compute environments.
Domain
AI infrastructure, distributed systems, performance engineering
Deliverable
production ML models
Required skills
distributed systems, performance engineering, systems tooling, infrastructure integration, operational monitoring, analytical debugging
Preferred skills
GPU clusters, AI infrastructure, model porting, inference/training workloads, token economics, observability
Technologies
None explicitly stated
Responsibilities
Develop systems to measure and monitor token throughput; support performance benchmarking and model porting; integrate external/partner infrastructure into internal compute stacks; develop operational metrics for billing, usage, and SLAs; identify bottlenecks in hardware, networking, and software; partner with compute, finance, and operations teams; build dashboards and automation for capacity visibility.
Seniority
Senior, hands-on IC
