CareerPlanSign in

AI Solution Architect (m/w/d)

Nürnberg, Mittelfranken, BAYERN🌐 Remote💼 Full-time🗓 2026-07-14 → 2026-09-26

Core

Designing and evolving end-to-end AI/ML architecture for complex enterprise environments on Azure, ensuring production-ready, scalable, and compliant AI solutions.

Role type

Senior AI Solution Architect (Technical Lead)

Builds

Enterprise AI platforms, ML pipelines, RAG architectures, and MLOps strategies for public sector clients.

Domain

Public sector (Transportation & Energy) / Cloud AI / MLOps

Deliverable

production ML models

Required skills

Azure Machine Learning, Azure OpenAI Service, MLOps (MLflow, Kubeflow, Azure ML Pipelines), RAG architecture design, Prompt Engineering, Vector databases, LLM API integration, Orchestration frameworks (LangChain, LlamaIndex), CI/CD for ML, Python, Machine Learning frameworks (scikit-learn, PyTorch, TensorFlow), Enterprise architecture in cloud, Containerization/Orchestration (Docker, Kubernetes), Infrastructure as Code (Terraform), Observability (Prometheus, Grafana, Application Insights), Governance and Compliance frameworks (ISO 27001, NIS2, BSI, EU AI Act)

Preferred skills

Azure certifications, Experience in Energy sector (Predictive Maintenance, Time-series analysis), Public procurement knowledge (VgV, EVB-IT)

Responsibilities

Designing and evolving the AI/ML overall architecture on Azure as an Enterprise AI platform; Technical leadership of ML pipeline projects (Training, Deployment, Monitoring, Drift Detection) and RAG architecture optimization; Defining MLOps strategies including CI/CD for models, experiment tracking, and model registry; Technical leadership and coordination of interdisciplinary teams (ML/AI Engineers, LLM Engineers, MLOps Engineers); Consulting on AI Governance, Responsible AI, and EU AI Act compliance.

Seniority

Senior, hands-on IC with technical leadership

Sourced via bundesagentur · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.