Senior Machine Learning Engineer, Inference
HybridVisa sponsorship offered
Core
Senior ML Engineer optimizing real-time voice and LLM inference for consumer-scale applications.
Role type
Senior IC machine learning inference engineer
Builds
High-performance, distributed inference systems for voice and LLMs
Domain
AI/ML inference systems, GPU computing
Deliverable
production ML models
Required skills
Inference engine optimization, GPU programming (C++, CUDA, Rust), Model acceleration (quantization, distillation, speculative decoding), Distributed systems, Kubernetes, Ray
Preferred skills
Open-source contributions, Technical publications, PhD in CS/Physics/Math
Technologies
vLLM, TensorRT-LLM, SGLang, Kubernetes, Ray, CUDA, C++, Rust, Python
