CareerPlan

ML Ops Engineer (EMEA Remote)

UkraineRemoteFull-time2026-09-23 → 2026-11-19
Remote

Core

Design and operate production-grade model serving infrastructure for AI/ML workloads, ensuring high availability, low latency, and cost-efficient inference systems.

Role type

Senior ML Ops Engineer (Infrastructure)

Builds

Scalable, reliable ML inference platforms and deployment pipelines

Domain

Cloud Computing / AI / Distributed GPU Systems

Deliverable

production ML models

Required skills

Model serving frameworks (vLLM, TGI, Triton), Container orchestration, GPU workload management, MLOps tooling, Python, Infrastructure-as-code (Terraform, Helm), Distributed systems, Performance tuning

Preferred skills

Kubeflow, MLflow, KubeAI, GPU scheduling, CUDA/ROCm optimization, Multi-tenant inference, Cost optimization

Technologies

vLLM, TGI, Triton, Terraform, Helm, Python, Kubernetes

Responsibilities

Build and operate production-grade model serving infrastructure; Design and implement robust deployment pipelines with blue/green and canary strategies; Develop auto-scaling systems and intelligent request routing; Optimize GPU utilization and memory efficiency; Design observability systems for inference metrics; Manage model registries and CI/CD pipelines; Own full lifecycle of ML systems from development to production

Seniority

Senior, hands-on IC