Senior / Lead Machine Learning Engineer, Serving - Germany
Core
Building and optimizing state-of-the-art realtime voice models for consumer-facing AI applications across health, fitness, learning, and media.
Role type
Senior / Lead Machine Learning Engineer, Serving
Builds
Realtime voice inference systems and APIs for developers
Domain
AI / Machine Learning / Realtime Voice
Deliverable
production ML models
Required skills
Inference optimization (vLLM, TRT-LLM), Model acceleration (quantization, distillation, caching, continuous batching, paged attention, speculative decoding), High-performance systems (C++, CUDA, Rust, Python profiling), Distributed systems (Kubernetes, Ray, multi-GPU/multi-node inference), Full-cycle model ownership
Preferred skills
Open-source contributions to inference engines, Non-trivial systems programming projects
Technologies
vLLM, TRT-LLM, C++, CUDA, Rust, Python, Kubernetes, Ray, NVIDIA GPUs
Responsibilities
Optimize realtime inference for voice models, Implement model acceleration strategies, Profile and optimize code for NVIDIA GPUs, Manage distributed inference systems, Containerize and deploy models to production
Seniority
Senior / Lead, hands-on IC