Senior Big Data Administrator
Core
Design, implement, and manage CI/CD pipelines for microservices and data workloads while building and maintaining cloud-native infrastructure.
Role type
Senior IC DevOps/Infrastructure Engineer (Cloud & Data)
Builds
Cloud-native infrastructure, CI/CD pipelines, and optimized Databricks environments for data engineering and analytics.
Domain
Cloud Infrastructure & Data Engineering
Deliverable
production ML models | infrastructure
Required skills
CI/CD pipeline management, Infrastructure as Code, container orchestration, Databricks cluster management, Unix/Linux shell scripting, Python/Bash/PowerShell scripting, monitoring and alerting automation, troubleshooting distributed systems.
Preferred skills
Data engineering pipelines (Spark, Delta Lake), streaming architectures (Kafka, Event Hubs), data lake/lakehouse architectures, multi-region high-availability setups, cloud certifications.
Technologies
AWS, Azure, GCP, Docker, Kubernetes (EKS/AKS/GKE), Databricks, Terraform, ARM, CloudFormation, Prometheus, Grafana, CloudWatch, Azure Monitor, Jenkins, GitHub Actions, Spark, Kafka.
Responsibilities
Design and manage CI/CD pipelines for microservices and data workloads; Build and maintain cloud-native infrastructure using Infrastructure as Code; Support deployment and orchestration of microservices-based applications; Manage and optimize Databricks environments; Automate operational workflows, monitoring, and alerting; Troubleshoot deployment, performance, and infrastructure issues.
Seniority
Senior, hands-on IC