Machine Learning Engineer, Foundation Model Services
Core
Build production-grade solutions to launch large language, vision, and speech models serving customers in real time across Apple products.
Role type
Senior IC machine learning engineer (foundation model services)
Builds
Inference services for large language, vision, and speech models
Domain
Consumer technology / Large-scale AI infrastructure
Deliverable
production ML models
Required skills
Go, Python, Kubernetes, Docker, cloud platforms (AWS/Azure/GCP), high-throughput low-latency service design, LLMs, NLP, Information Retrieval, Statistics
Preferred skills
Nvidia TensorRT-LLM, vLLM, DeepSpeed, Nvidia Triton Server
Responsibilities
Partner with product teams to build production-grade solutions for real-time model serving; Collaborate with researchers to prototype inference for cutting-edge model architectures; Build tools to identify and remove performance bottlenecks across hardware and use cases
Seniority
Senior, hands-on IC