742/B - LLMOps Engineer für KI-Services (m/w/d)
Core
Build, test, and deploy scalable, secure, and performant AI solutions and services for data-driven banking for over 50 million customers.
Role type
LLMOps Engineer (Technical Project Manager)
Builds
Central AI and Data Analytics platform for internal and external clients (Sparkassen and partners)
Domain
Banking / Financial Services / AI Infrastructure
Deliverable
production ML models
Required skills
Kubernetes, CI/CD pipelines (Jenkins, GitHub Actions, GitLabCI), Helm Charts, ArgoCD, LLM inference tools (Nvidia Triton, NIM, HuggingFace TGI/TEI, vLLM), Redis
Preferred skills
Experience with unimodal and multimodal AI models, Redis data structures (Caching, Streams, Queues, Pub/Sub)
Technologies
Kubernetes, ArgoCD, Helm, GitHub Actions, Nvidia Triton, Huggingface, Redis, Jenkins, GitLabCI
Responsibilities
Build and maintain CI/CD pipelines for container applications; Deploy container applications in Kubernetes clusters using Helm and ArgoCD; Integrate unimodal and multimodal AI models; Operate and ensure high availability of Redis instances; Collaborate on architecture decisions and develop best practices for Redis usage; Support internal teams with Redis implementation questions.
Seniority
Junior to Mid-level, hands-on IC
