Operations Manager - AI Services
Core
Building and operating a central enterprise-level LLM service to provide secure, reliable, and cost-effective access to Large Language Models for development teams and business applications.
Role type
Senior Operations Manager (AI Services / LLM Platform)
Builds
Centralized LLM service catalog, governance controls, and automated provisioning workflows for enterprise AI models.
Domain
Enterprise AI / Large Language Models (LLM) / Cloud Operations
Deliverable
production ML models
Required skills
Platform or cloud operations, LLM operations, API management, authentication, observability, production service operations, stakeholder communication
Preferred skills
LLMOps platforms, AI gateway management, model evaluation, AI observability, FinOps, provider management, usage-based cloud services, ITIL-based service management
Technologies
LLMs, APIs, authentication systems, observability tools, cloud platforms
Responsibilities
Evaluate incoming AI use cases and assist teams in selecting appropriate LLM models; Balance technical quality, security, compliance, availability, and costs; Manage the LLM catalog including service requests, approvals, access, credentials, quotas, and onboarding; Establish monitoring, logging, security, and governance operational controls; Develop transparent consumption and cost models and prepare for automation of provisioning and reporting; Provide a fast, practical path to approved LLM access for colleagues; Collaborate on transforming manual workflows into standardized and automated services.
