AI Platform Engineer - LLMOps (m/w/d)
Core
Build and maintain the internal AI platform for local LLMs, GPU infrastructure, and enterprise AI chat tools.
Role type
AI Platform Engineer (LLMOps)
Builds
GPU server infrastructure, local LLM deployments, and enterprise AI chat interfaces
Domain
AI/ML Infrastructure, LLM Operations
Deliverable
production ML models
Required skills
Linux, Docker, Python, Bash, GPU stack management, LLM deployment, monitoring tools
Preferred skills
vLLM, LiteLLM, Ollama, benchmarking, pipeline automation
Responsibilities
Maintain GPU servers and infrastructure, deploy and manage local LLMs, operate enterprise AI chat tools, benchmark models and configurations, integrate AI into business processes
Seniority
Entry to Senior (flexible based on experience)