SDE II, ML Infra Services, Annapurna Labs
Core
Lead the design and implementation of an ML infrastructure platform to run, optimize, and analyze machine learning workloads on AWS ML accelerators.
Role type
Senior IC software engineer (ML infrastructure)
Builds
ML infrastructure platform for capacity management, workload scheduling, and fleet orchestration across ML accelerators
Domain
Cloud computing, Machine Learning Infrastructure, Custom Silicon
Deliverable
production ML models
Required skills
Distributed systems design, Go/Java/Rust, Kubernetes/EKS, Profiling and optimization, Resource management, Scheduling, Code generation, System architecture
Preferred skills
Server-side development, Full SDLC ownership, Incident response, Cross-functional leadership, Python, JavaScript/TypeScript
Technologies
Go, Java, Rust, Python, Kubernetes, EKS
Responsibilities
Design and code solutions for software architecture efficiency, create metrics and implement automation, resolve root cause of software defects, participate in design discussions and code reviews, work cross-functionally to drive business decisions
Seniority
Senior, hands-on IC