NTT DATA Deutschland SE: Lead Private AI Architect (w/m/x) - GenAI, LLM & Enterprise AI Platforms
Core
Designing and implementing secure, scalable, sovereign Enterprise AI and GenAI platforms for clients, bridging architecture, infrastructure, and consulting.
Role type
Senior IC Private AI Architect (GenAI/LLM)
Builds
Private AI and GenAI platforms, LLM/RAG/Agentic AI architectures, and production-ready AI solutions for enterprise workloads.
Domain
Enterprise AI, Generative AI, Cloud Infrastructure, Security & Compliance
Deliverable
production ML models
Required skills
LLMs, RAG, Vector Databases, Prompt Engineering, Agentic AI, Kubernetes, Docker/OpenShift, MLOps/LLMOps, GPU/AI Infrastructure, Security & Privacy
Preferred skills
Sovereign AI, Zero Trust, IAM/RBAC, Data Residency, Regulatory Compliance
Technologies
LangChain, LlamaIndex, Haystack, Semantic Kernel, Llama, Mistral, DeepSeek, Qwen, MLflow, Kubeflow, KServe, Ray, vLLM, Ollama, NVIDIA Stack, CUDA, MIG
Responsibilities
Designing High-Level and Low-Level designs, Blueprints, and Reference Architectures for On-Premises, Private-Cloud, Hybrid, and Sovereign AI environments; Developing scalable Inference Architectures for Enterprise AI workloads; Integrating AI platforms with Kubernetes, Containerization, and MLOps/LLMOps for production deployment, evaluation, monitoring, and governance; Acting as a Trusted Advisor for AI Strategy, Platform Modernization, Infrastructure Readiness, and AI Operating Models; Driving POCs, MVPs, and Enterprise AI initiatives; Connecting AI, Infrastructure, Cloud, Security, and Data Engineering to manage RFPs, proposals, and reusable Private AI frameworks.
Seniority
Senior, hands-on IC
