Sovereign AI Platform Engineer (DevOps Engineer) (m/f/d)
Core
Design, build, and operate a sovereign AI toolchain for enterprise AI engineering workloads in isolated or tightly controlled environments.
Role type
Senior Platform Engineer (DevOps/MLOps)
Builds
Kubernetes-based platform for open-source LLM stacks, model serving, retrieval, and orchestration in air-gapped settings.
Domain
Sovereign AI infrastructure, on-prem/dedicated hardware, secure enterprise environments.
Deliverable
production ML models | infrastructure
Required skills
Kubernetes, Linux, Python, Infrastructure as Code, GitOps, GPU management, networking, storage, access control, observability
Preferred skills
MLOps, model serving (vLLM, Ollama), vector databases, private registries, editor integrations
Technologies
Kubernetes, Helm, Terraform, Ansible, ArgoCD, vLLM, Ollama, llama.cpp, Qdrant, Open WebUI
Responsibilities
Design and run Kubernetes environments optimized for AI inference and agent execution; Deploy and operate open-source model stacks and supporting platform components; Manage local registries, secrets, and networking in isolated environments; Optimize GPU and compute usage for reliable AI workloads.
Seniority
Senior, hands-on IC
