Lead/Senior Inference Engineer
Core
Build and operate production inference infrastructure powering advanced large language models and AI-driven professional applications.
Role type
Senior IC inference engineer (LLM serving)
Builds
Production-grade model-serving platform for large-scale AI workloads
Domain
AI/ML infrastructure, Large Language Models
Deliverable
production ML models
Required skills
Kubernetes, distributed systems, model-serving infrastructure, inference optimization, observability, compliance frameworks, cost tracking, incident management, technical strategy, mentorship
Preferred skills
vLLM, TensorRT-LLM, Triton, SGLang, GPU-cluster capacity planning, multi-region/multi-cloud deployment, regulated environments (ISO 27001, SOC 2), systems programming (Rust, Go), systems-level performance optimization