Data Platform DevOps Engineer
Core
Building and maintaining CI/CD pipelines, infrastructure automation, and operational tooling for an enterprise data lakehouse.
Role type
Senior IC Data Platform DevOps Engineer
Builds
Reliable, scalable, cost-optimized data lakehouse infrastructure and tooling
Domain
Cloud Infrastructure / Data Platform Engineering
Deliverable
infrastructure
Required skills
Terraform, Helm, Kubernetes, CI/CD platforms (GitHub Actions, Jenkins, GitLab CI), Cloud platforms (AWS, Azure, GCP), Scripting (Bash, Python, Go), Container orchestration (Docker), Observability tools (Prometheus, Grafana, OpenTelemetry)
Preferred skills
Databricks Terraform provider, Snowflake deployment automation, GitOps workflows (ArgoCD, Flux), Kubernetes certifications (CKA), AWS DevOps Professional, HashiCorp Terraform certification
Technologies
GitHub Actions, Jenkins, GitLab CI, Terraform, Helm, Kubernetes, Airflow, Spark, DataHub, Prometheus, Grafana, OpenTelemetry, AWS, Azure, GCP, Docker, ArgoCD, Flux, HoneyComb, ELK stack, Datadog
Responsibilities
Design and maintain CI/CD pipelines for data pipeline deployments; Author and manage Infrastructure-as-Code (IaC) for lakehouse components; Manage Kubernetes clusters for orchestration workloads; Implement platform observability with logging, metrics, and alerting; Automate environment provisioning for development, staging, and production; Collaborate with data engineering and security teams to enforce policy-as-code; Manage cloud cost optimization strategies; Develop runbooks, SOP documentation, and on-call playbooks; Drive SLA compliance through capacity planning and incident response; Evaluate and introduce new DevOps tooling
Seniority
Senior, hands-on IC
