LLM Ops Engineer
Core
Build and operate a scalable, secure AI platform enabling engineering teams to deploy and manage LLMs across multiple providers.
Role type
Senior IC LLM Ops Engineer
Builds
Production-grade AI platform, unified APIs, and self-service tooling for model deployment
Domain
Legal Tech / AI Infrastructure
Deliverable
production ML models
Required skills
DevOps, MLOps, LLM production operations, multi-provider model management, high-availability infrastructure, API management, Python, secrets management, access controls
Preferred skills
LLM fine-tuning, ML orchestration (Kubeflow, MLflow, Airflow), RAG, vector databases, infrastructure-as-code, Kubernetes, cost optimization
Technologies
OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Google Vertex AI, Kubernetes, Python
Responsibilities
Build scalable AI platform for multi-provider model deployment; Ensure high availability via intelligent routing and failover; Establish secure and compliant AI operations; Create consistent developer experience via unified APIs; Optimize platform performance and cost; Lead evolution of AI operations capabilities; Deliver observability and operational excellence
Seniority
Senior, hands-on IC
