Senior / Lead Machine Learning Engineer, Serving - Germany
Core
Building and optimizing high-performance, sub-second multimodal inference systems for real-time voice models used in consumer AI applications.
Role type
Senior / Lead Machine Learning Engineer, Serving
Builds
Realtime voice models and inference APIs for health, fitness, learning, therapy, companions, and media applications.
Domain
AI / Machine Learning / Real-time Inference
Deliverable
production ML models
Required skills
Inference optimization (vLLM, TRT-LLM), Model acceleration (quantization, distillation, caching, continuous batching, paged attention, speculative decoding), High-performance systems programming (C++, CUDA, Rust, optimized Python), Distributed systems & scaling (Kubernetes, Ray, multi-GPU/multi-node inference), Full-cycle ownership of model serving
Preferred skills
Open-source contributions to inference engines, Deep-dive technical write-ups, PhD in CS/Physics/Math or equivalent practical experience
Technologies
vLLM, TRT-LLM, C++, CUDA, Rust, Python, Kubernetes, Ray, NVIDIA GPUs
Responsibilities
Optimize model inference latency and throughput, Profile and squeeze performance out of GPU hardware, Manage distributed inference clusters, Containerize and deploy models to production, Design benchmarks and prototypes for unclear problems
Seniority
Senior, hands-on IC with potential for lead responsibilities