Senior - AI Deployment Engineer
Core
Lead the transition of AI-powered solutions from development into secure, reliable, and cost-efficient production environments, combining DevOps, SRE, and LLMOps practices.
Role type
Senior AI Deployment Engineer (LLMOps/DevOps)
Builds
CI/CD pipelines, model serving infrastructure, and agentic environments
Domain
AI/ML Operations, Cloud Infrastructure, DevOps
Deliverable
production ML models
Required skills
LLMOps, DevOps engineering, Site Reliability Engineering (SRE), AI security, observability, AI FinOps, infrastructure guardrails, model routing
Preferred skills
Infrastructure as Code (IaC), Azure Container Apps, Kubernetes (K8s), cloud computing architectures
Technologies
CI/CD, Terraform, Azure Container Apps, Kubernetes, model serving platforms
Responsibilities
Design and manage CI/CD pipelines for agentic environments; Deploy conventional applications across platforms and distribution channels; Provision, automate, and maintain standardized development, staging, and production environments; Operate and manage model and AI agent serving infrastructure; Establish quality, security, and compliance gates throughout the delivery pipeline; Define and manage versioning strategies, release schedules, rollback procedures, and rapid recovery processes; Implement observability and monitoring for AI solutions; Manage AI FinOps activities by monitoring and optimizing inference costs; Secure production environments through access controls and data protection measures; Implement infrastructure guardrails to manage model risk; Share production insights with upstream engineering teams; Apply responsible AI, ethics, privacy, data security, and compliance practices