Software Engineer Neuron Containers, Annapurna Labs, Neuron Containers, Annapurna Labs
Core
Build platform integrations enabling customers to run distributed training and inference workloads on AWS Neuron ML accelerators at scale.
Role type
Senior Software Development Engineer (Container Platform & ML Infrastructure)
Builds
Neuron integration with Kubernetes/ECS/Slurm, Deep Learning Containers (DLCs), and Deep Learning AMIs (DLAMIs) for Trainium and Inferentia instances.
Domain
Cloud Infrastructure, Machine Learning Accelerators, Container Orchestration
Deliverable
production ML models | infrastructure
Required skills
Distributed systems design, container platform integration, Kubernetes operator frameworks, large-scale cluster infrastructure, software development lifecycle, debugging performance/scalability issues
Preferred skills
Helm, Prometheus, AWS compute services (EC2, EKS, ECS, ECR), container image pipelines, open-source contributions to Kubernetes ecosystem
Technologies
Kubernetes, ECS, Slurm, EKS, EC2, SageMaker, Docker, Helm, Prometheus
Responsibilities
Design and implement container platform integrations (device plugins, DRA drivers, operators), build and maintain Neuron DLCs and DLAMIs, diagnose and resolve performance/scalability issues, simplify systems by deprecating legacy software, deliver software across the full development lifecycle
Seniority
Senior, hands-on IC