DevOps Engineer SE II - GCP & AI
Core
Own Helpshift production services and build deployment pipelines for AI agents, managing vector databases and model endpoints on GCP.
Role type
Senior DevOps Engineer (GCP & AI/LLMOps)
Builds
Production services for Helpshift, AI agent deployment pipelines, and scalable GCP infrastructure.
Domain
Cloud Infrastructure (GCP) + AI/LLMOps
Deliverable
production ML models | infrastructure
Required skills
GCP administration (GKE, Cloud Run, Vertex AI), Terraform, Kubernetes, Docker, Python, Bash, Vector Databases (Pinecone, Weaviate, ElasticSearch), CI/CD pipeline architecture, observability for LLM metrics, IAM security, cost optimization for GPU/TPU workloads.
Preferred skills
Cross-cloud connectivity (AWS <> GCP), UNIX-like OS management, networking protocols, mentoring junior members.
Technologies
GCP, Terraform, Kubernetes, Docker, Vertex AI, Pinecone, Weaviate, ElasticSearch, Ansible, Secret Manager, GKE, Cloud Run, GCS.
Responsibilities
Own Helpshift production services and ensure monitoring coverage; Design and maintain scalable GCP infrastructure using Terraform; Build deployment pipelines for AI agents and manage vector databases; Implement Security-by-Design including IAM least-privilege and automated vulnerability scanning; Architect high-velocity CI/CD pipelines for microservices and AI configurations; Set up comprehensive monitoring for system health and LLM-specific metrics; Optimise GCP costs and manage resource quotas for GPU/TPU tasks; Establish connectivity among apps deployed in different cloud environments.
Seniority
Senior, hands-on IC