Senior AI Operations Engineer, Enterprise Tech
Core
Building, operating, and improving the infrastructure behind enterprise AI capabilities, including LLM integrations, automation, and production systems.
Role type
Senior AI Operations Engineer (Enterprise Tech)
Builds
Internal tooling, automation, self-service solutions, and observability pipelines for AI workloads.
Domain
Enterprise AI infrastructure, LLM operations, cloud/on-prem systems
Deliverable
production ML models
Required skills
Linux administration, Python/Bash scripting, Terraform/Ansible/Kubernetes, LLM API integration, system reliability monitoring, root cause analysis, cross-functional collaboration
Preferred skills
GPU cluster management, AI workload orchestration (Slurm/Ray), vector databases (Pinecone/Milvus), RAG systems, hybrid cloud infrastructure
Technologies
Anthropic Claude, Google Gemini, Terraform, Ansible, Chef, Kubernetes, Python, Bash, Linux, Slurm, Ray, Pinecone, Milvus, LangChain, LlamaIndex
Responsibilities
Build internal tooling and automation to streamline AI operations; troubleshoot complex issues across AI platforms and LLM integrations; manage and optimize enterprise LLM provider integrations; develop observability and monitoring pipelines for AI workloads; support and optimize agentic workflows and RAG systems; partner with engineering and product teams to drive long-term AI capability improvements
Seniority
Senior, hands-on IC
