Software Development Engineer, AI Runtime
Core
Design and implement Tier-1 distributed systems to orchestrate expert agent executions and manage LLM inference pipelines for Alexa+.
Role type
Senior Software Development Engineer (AI Runtime Infrastructure)
Builds
Large-scale distributed services, LLM orchestration pipelines, multi-agent coordination systems
Domain
Cloud infrastructure, AI/ML systems, Distributed systems
Deliverable
production ML models | infrastructure
Required skills
Distributed systems design, LLM orchestration, Model serving, Multi-agent coordination, System reliability, Architectural decision making, Code review, Technical leadership
Preferred skills
Full SDLC ownership, System design with AI components, Latency and cost optimization
Technologies
LLM frameworks, Distributed computing frameworks, Cloud infrastructure tools
Responsibilities
Design and operate large-scale distributed services, Develop and optimize LLM orchestration pipelines, Build multi-agent coordination systems, Ensure operational excellence for Tier-1 services, Collaborate with applied scientists and ML engineers, Mentor teammates and raise the engineering bar