Software Development Engineer I, ML Infra Services, Annapurna Labs
Core
Build and evolve machine learning tools that run, optimize, and analyze ML workloads on custom AI accelerators (AWS Neuron stack).
Role type
Software Development Engineer I, ML Infra Services
Builds
High-impact tooling for profiling, optimization, and resource management of ML workloads on custom accelerators.
Domain
Cloud-scale machine learning infrastructure, custom silicon, AI accelerators
Deliverable
production ML models
Required skills
Java, Python, C++, C#, Go, Rust, TypeScript, object-oriented design, data structures, algorithms, Git, CI/CD pipelines
Preferred skills
optimization mathematics, distributed systems, relational databases, cloud platforms, SQL/NoSQL, Linux performance profiling, compiler toolchains, instruction set architectures
Technologies
Kubernetes, AWS (EKS, EC2, Lambda, S3, DynamoDB, SQS), Linux
Responsibilities
Design and implement tooling for profiling, optimization, and resource management of ML workloads; Build high-impact solutions that ship to a large customer base; Create metrics, implement automation, and resolve root causes of software defects.
Seniority
Individual Contributor (IC), entry-level to mid-level