Intermediate Cloud AI & LLMOps Engineer (m/w/d)
Core
Design, operate, and optimize LLMOps infrastructure for deploying, monitoring, and tracing Large Language Models (LLMs) in enterprise environments.
Role type
Intermediate Cloud AI & LLMOps Engineer
Builds
Stable LLM deployment pipelines, monitoring/tracing systems, and optimized inference environments
Domain
Cloud AI / LLMOps / Enterprise Infrastructure
Deliverable
production ML models
Required skills
LLMOps pipelines (deployment, monitoring, evaluation, tracing), Cloud platforms (Azure, AWS, GCP) and AI services, Container orchestration (Docker, Kubernetes), CI/CD pipelines, Infrastructure as Code (Terraform), Inference optimization (quantization, caching), AI FinOps (cost optimization)
Preferred skills
Security and compliance standards for enterprise data in cloud environments
Technologies
LangSmith, Arize Phoenix, Azure OpenAI Service, AWS Bedrock, Terraform, Docker, Kubernetes
Responsibilities
Design and maintain LLMOps pipelines for LLM deployment and monitoring; Optimize model performance and latency in production; Integrate cloud AI services with enterprise infrastructure; Monitor and optimize token usage and cloud costs; Automate infrastructure setup using IaC; Act as a bridge between AI developers and IT operations
Seniority
Intermediate, hands-on IC
