CareerPlan

Machine Learning Engineer

Hyderabad, IndiaFull-time2026-11-12 → 2026-11-16

Core

Operate and optimize multi-tenant LLM inference, model serving, VectorDB/RAG, and MCP platforms across global cloud and GPU clusters to ensure high availability, scalability, and cost-efficiency.

Role type

Senior Machine Learning Infrastructure Engineer (SRE focus)

Builds

Core AI runtime, developer infrastructure, and multi-tenant inference services for Splunk and Cisco

Domain

Cloud-native AI infrastructure, Distributed Systems, GPU Orchestration

Deliverable

production ML models

Required skills

Python, Go, Java, Kubernetes, Prometheus, Grafana, Splunk, OpenTelemetry, AWS, Azure, GCP

Preferred skills

vLLM, TensorRT-LLM, Ray Serve, KServe, Milvus, Pinecone, Redis, RAG pipelines, Model Context Protocol (MCP), chaos engineering

Technologies

Kubernetes, vLLM, Ray, Prometheus, Grafana, Splunk, OpenTelemetry, Milvus, Pinecone, Redis

Responsibilities

Scale core AI services across global cloud and GPU clusters; Establish and monitor SLOs, SLIs, and observability dashboards; Build automation for rollouts, autoscaling, and disaster recovery; Tune GPU and inference performance; Lead complex production incident response and root-cause analysis; Partner with AI researchers and product teams on production readiness.

Seniority

Senior, hands-on IC