AI Inference Engineer (all genders)
Core
Design and operate productive LLM inference platforms on-premises and in private clouds.
Role type
AI Inference Engineer
Builds
LLM inference platforms
Domain
AI/ML, Cloud Infrastructure
Deliverable
production ML models
Required skills
GPU resource optimization, quantization, latency optimization, Kubernetes, Docker, observability
Technologies
Kubernetes, Docker
Responsibilities
Design and operate LLM inference platforms; Optimize GPU resources, quantization, and latency; Integrate Kubernetes, Docker, and observability into secure, scalable AI systems.
