Senior Distinguished Engineer, AI Compute (Remote Eligible)
Core
Architecting and building control and data plane implementations for a highly available, multi-tenant, large-scale machine learning platform powering LLM training, inference, and agentic applications.
Role type
Senior Distinguished Engineer (hands-on IC)
Builds
Cloud-based enterprise AI+ML system delivering high-scale developer and runtime environments for compute and data-intensive AI systems.
Domain
Banking / Distributed Systems / AI Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Distributed systems architecture, Golang, Python, Ray, Spark, Kubernetes, serverless runtime environments, ML+AI workload patterns, system design, code review, technical mentorship, external recruiting.
Preferred skills
Internals of Ray (Actors/GCS/Scheduling) or Spark (Query Optimizer/Memory Management), LLM training/fine-tuning platform experience, AWS-specific compute primitives (EKS, EC2 UltraClusters, Graviton), upstream contributions to major distributed systems projects.
Technologies
Golang, Python, Ray, Spark, Kubernetes, AWS Lambda, AWS EKS, EC2 UltraClusters, Graviton
Responsibilities
Architect and build control and data plane implementations for a highly available, multi-tenant, large scale and a secure machine learning platform; Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads; Engineer systemic improvements for operational excellence including automating KTLO workflows; Direct the technical execution of a diverse project portfolio; Lead the way in creating next-generation talent, mentoring internal talent and actively recruiting external talent.
Seniority
Senior, hands-on IC