Machine Learning Engineer
Core
Operate and optimize multi-tenant LLM inference, model serving, VectorDB/RAG, and MCP platforms across global cloud and GPU clusters to ensure high availability, scalability, and cost-efficiency.
Role type
Senior Machine Learning Infrastructure Engineer (SRE focus)
Builds
Core AI runtime, developer infrastructure, and multi-tenant inference services for Splunk and Cisco
Domain
Cloud-native AI infrastructure, Distributed Systems, GPU Orchestration
Deliverable
production ML models
Required skills
Python, Go, Java, Kubernetes, Prometheus, Grafana, Splunk, OpenTelemetry, AWS, Azure, GCP
Preferred skills
vLLM, TensorRT-LLM, Ray Serve, KServe, Milvus, Pinecone, Redis, RAG pipelines, Model Context Protocol (MCP), chaos engineering
Technologies
Kubernetes, vLLM, Ray, Prometheus, Grafana, Splunk, OpenTelemetry, Milvus, Pinecone, Redis
Responsibilities
Scale core AI services across global cloud and GPU clusters; Establish and monitor SLOs, SLIs, and observability dashboards; Build automation for rollouts, autoscaling, and disaster recovery; Tune GPU and inference performance; Lead complex production incident response and root-cause analysis; Partner with AI researchers and product teams on production readiness.
Seniority
Senior, hands-on IC