AI Workbench Admin (Hybrid)
Core
Administer and maintain enterprise AI Workbench platforms, managing access, security, agent lifecycles, and RAG-based retrieval layers for private, on-premise, hybrid, or cloud environments.
Role type
Senior AI Platform Administrator (GenAI/LLM Ops)
Builds
Secure AI agent deployments, RAG pipelines, and enterprise AI workbench environments
Domain
Enterprise AI/GenAI, Cloud Infrastructure, Cybersecurity
Deliverable
production ML models | infrastructure
Required skills
AI Workbench administration, RAG architecture, vector databases, RBAC/Identity management, Azure cloud services, Kubernetes/Container orchestration, CI/CD pipelines, Generative AI/LLM operations, data privacy and encryption
Preferred skills
NVIDIA GPU infrastructure, API management, zero-trust architecture, enterprise compliance frameworks
Technologies
LiteLLM, Kong, Dagster, Langfuse, Milvus, Chroma, Pinecone, Azure DevOps, Azure OpenAI, Azure PostgreSQL, Azure Blob Storage, Azure Application Gateway, Kubernetes, Argo CD, ServiceNow, SAP, SharePoint, MCP registries
Responsibilities
Configure user access, role-based access control, and platform security settings; Support onboarding of users, teams, agents, workflows, APIs, and LLM connections; Monitor platform health, availability, security, and performance metrics; Manage AI agent lifecycle activities including registration, configuration, deployment, and versioning; Coordinate with DevOps/DataOps teams to maintain CI/CD pipelines and environment configuration; Maintain governance controls for prompts, agents, workflows, and audit logging
Seniority
Senior, hands-on IC