AI Platform/ DevOps Engineer
Core
Building scalable, observable, secure, and cost-efficient platform infrastructure on AWS and Databricks to support RAG pipelines, LLM orchestration, vector search, and evaluation workflows.
Role type
Senior IC platform and infrastructure engineer (AI/ML focus)
Builds
Cloud-native AI platform infrastructure, containerized services, CI/CD pipelines, and vector search systems
Domain
Generative AI, Cloud Infrastructure, DevOps
Deliverable
infrastructure
Required skills
AWS (Lambda, API Gateway, DynamoDB, S3, CloudWatch), Kubernetes (EKS, ECS), Terraform, CI/CD pipeline management, Vector databases (OpenSearch, Algolia), Python scripting, Distributed systems architecture, Microservices design, API design, Observability (MLflow, OpenTelemetry), Security (IAM, encryption, network controls)
Preferred skills
Experience with AWS Bedrock Knowledge Bases
Technologies
AWS, Databricks, Kubernetes, Terraform, OpenSearch, Algolia, Python, CloudWatch, MLflow, OpenTelemetry, EKS, ECS, Lambda, API Gateway, DynamoDB, S3, Bedrock
Responsibilities
Design, build, and operate cloud-native AI platform infrastructure; Deploy and operate containerized services on Kubernetes using Terraform; Own and scale vector search infrastructure and embedding pipelines; Build and maintain CI/CD pipelines for inference services and RAG components; Implement observability across AI workloads; Apply secure-by-design principles including IAM and encryption; Work with AI engineers to translate prototypes into production-ready components
Seniority
Senior, hands-on IC