ML Ops Engineer (EMEA Remote)
Core
Design and operate production-grade model serving infrastructure for AI/ML workloads, ensuring high availability, low latency, and cost-efficient inference systems.
Role type
Senior ML Ops Engineer (Infrastructure)
Builds
Scalable, reliable ML inference platforms and deployment pipelines
Domain
Cloud Computing / AI / Distributed GPU Systems
Deliverable
production ML models
Required skills
Model serving frameworks (vLLM, TGI, Triton), Container orchestration, GPU workload management, MLOps tooling, Python, Infrastructure-as-code (Terraform, Helm), Distributed systems, Performance tuning
Preferred skills
Kubeflow, MLflow, KubeAI, GPU scheduling, CUDA/ROCm optimization, Multi-tenant inference, Cost optimization
Technologies
vLLM, TGI, Triton, Terraform, Helm, Python, Kubernetes
Responsibilities
Build and operate production-grade model serving infrastructure; Design and implement robust deployment pipelines with blue/green and canary strategies; Develop auto-scaling systems and intelligent request routing; Optimize GPU utilization and memory efficiency; Design observability systems for inference metrics; Manage model registries and CI/CD pipelines; Own full lifecycle of ML systems from development to production
Seniority
Senior, hands-on IC