Director AI Engineering (Remote Eligible)
Core
Building and operating the platform for training, fine-tuning, and experimenting with foundation models at scale, including GPU clusters, distributed training infrastructure, and self-service environments.
Role type
Director, AI Infrastructure & Platform Engineering
Builds
GPU clusters, distributed training infrastructure, self-service model experimentation environments, and enterprise AI governance frameworks
Domain
Financial Services / Generative AI Infrastructure
Deliverable
infrastructure
Required skills
Large-scale distributed training, GPU fleet management, cloud infrastructure (AWS), ML orchestration (Kubernetes, Ray, KServe), Python/Go/C++, cost governance, team leadership, technical strategy
Preferred skills
Multi-node multi-GPU job management, fault tolerance, right-sizing GPU clusters, cross-functional organization leadership, regulatory compliance frameworks
Technologies
PyTorch, DeepSpeed, Megatron, Kubernetes, Kubeflow, Kueue, Slurm, Ray, KServe, vLLM, AWS Ultraclusters, Huggingface, VectorDBs
Responsibilities
Oversee design and operation of core AI platform systems; make build-vs-buy decisions on AI technologies; plan GPU capacity and cost governance; establish enterprise Responsible AI standards; scale engineering practices across teams; attract and retain top AI talent
Seniority
Director, hands-on IC with people leadership
