Software Development Engineer II, AWS SageMaker AI
Core
Design, build, and operate distributed systems for the Model Factory platform to orchestrate foundation model training, evaluation, and deployment at scale.
Role type
Senior Software Development Engineer (Distributed Systems)
Builds
Orchestration engine, compute integrations, SDK, and infrastructure for large-scale training jobs
Domain
Cloud Infrastructure / Generative AI / Distributed Systems
Deliverable
production ML models | infrastructure
Required skills
Distributed systems design, C#/C++/Java/Perl, Object Oriented Design, Large-scale multi-tiered applications, End-to-end service ownership
Preferred skills
Workflow orchestration, Kubernetes/EKS, Cloud infrastructure-as-code, ML training frameworks, GPU/accelerator compute
Technologies
SageMaker, EMR, AWS Batch, Kubernetes/EKS, PyTorch, FSDP, verl, NeMo, Megatron, AWS CDK, CloudFormation
Responsibilities
Design and build contract-validated workflows for model lifecycle; Develop compute-backend integrations and job launchers; Improve resiliency with checkpoint/resume and fault detection; Contribute to SDK and schema/contract layer; Integrate containerized training frameworks; Collaborate with ML scientists to translate requirements into platform capabilities
Seniority
Senior, hands-on IC