Senior Software Engineer, AI Platform
Core
Design and implement core managed AI services including fault-tolerant queues, model catalogs, and scheduling mechanisms to support millions of API requests per second.
Role type
Senior IC platform engineer (AI infrastructure)
Builds
Managed AI services, scalable infrastructure, and open-source AI frameworks
Domain
Cloud infrastructure, distributed systems, generative AI
Deliverable
production ML models | infrastructure
Required skills
distributed systems, cloud compute, storage, networking, databases, generative AI (LLMs, multimodal), AI infrastructure (training, inference, ETL), container runtimes, Kubernetes, microservices, REST APIs, gRPC, software development lifecycle
Preferred skills
Go, Python, Rust, open-source AI contributions (vLLM), GPU system optimization, inference framework optimization
Responsibilities
Lead design and implementation of core managed AI services, architect and scale infrastructure for high-volume API requests, implement monitoring and alerting for system health, collaborate on AI platform roadmap, prototype emerging technologies, contribute to open-source AI frameworks
Seniority
Senior, hands-on IC
