Lead Software Engineer - ML Platform
Core
Design, build, and maintain an end-to-end ML training platform on AWS, optimizing GPU workloads for Gen AI and LLM training.
Role type
Lead Software Engineer - ML Platform
Builds
Scalable, reliable ML training systems and pipelines on AWS
Domain
Cloud Infrastructure / Machine Learning / Generative AI
Deliverable
production ML models
Required skills
Python, Deep Learning frameworks (PyTorch/TensorFlow), Kubernetes, AWS services (EKS, EC2, S3, IAM, VPC, CloudWatch), Distributed training (DDP, FSDP, DeepSpeed), CI/CD automation, System profiling and tuning, Responsible AI engineering practices
Preferred skills
NodeJS, Airflow, Spark, LLM fine-tuning workflows
Technologies
AWS, Kubernetes, PyTorch, TensorFlow, Python, CI/CD, CloudWatch, EC2, IAM, VPC, DeepSpeed, FSDP, DDP
Responsibilities
Design and maintain end-to-end ML training platform; Run and optimize single-node and distributed GPU training workloads; Build and operate training infrastructure on Kubernetes; Support Gen AI and LLM training and fine-tuning workflows; Implement observability for training systems; Partner with data engineering and platform teams on security and cost control; Improve developer experience through standardized containers and self-service workflows; Drive adoption of enterprise-authorized AI-assisted engineering practices.
Seniority
Lead, hands-on IC with team leadership
