CareerPlanSign in

Senior AI Operations Engineer

Bangalore, India💼 Full-time🗓 2026-10-01

Core

Operate and maintain enterprise AI platforms, services, and containerized workloads on Microsoft Azure, ensuring reliability, scalability, and security for generative AI applications.

Role type

Senior AI Operations Engineer (MLOps/SRE)

Builds

Enterprise AI platforms, containerized AI workloads, and governed model-access gateways

Domain

Cloud Infrastructure & AI Operations

Deliverable

production ML models

Required skills

Azure AI services, Kubernetes, Terraform, CI/CD pipelines, observability, incident management, security hardening, automation scripting

Preferred skills

Generative AI deployment, RAG architecture, multi-cloud gateway management, developer enablement

Technologies

Azure OpenAI, Azure AI Foundry, Azure Kubernetes Service, Docker, Terraform, Azure DevOps, GitHub Actions, OpenTelemetry, Azure Monitor

Responsibilities

Operate and maintain enterprise AI platforms across development, test, and production environments; Deploy and operationalize AI and Generative AI workloads including copilots and RAG services; Manage containerized AI workloads using Docker and Kubernetes; Operate the governed model-access layer for provider routing and quota management; Implement monitoring, logging, and alerting for AI system utilization and performance; Develop and maintain Infrastructure as Code using Terraform; Build and maintain CI/CD pipelines for automated deployment and validation; Investigate and resolve platform incidents and perform root cause analysis.

Seniority

Senior, hands-on IC

Sourced via workday · Listed on CareerPlan, which tracks 922,000+ jobs from 20+ sources.