Azure Databricks Administrator
Core
L1/L2 operational support, monitoring, administration, and maintenance of the enterprise Azure Data Platform to ensure high availability, stability, security, and performance.
Role type
Azure Databricks Platform Administrator
Builds
Scalable data platforms and pipelines (batch & streaming) on Azure Databricks and ADLS
Domain
Cloud Data Engineering / Azure Platform Operations
Deliverable
infrastructure
Required skills
Azure Databricks administration, Azure Data Lake Storage (ADLS), Confluent Kafka support, Kubernetes management, Linux basics, Infrastructure as Code (Terraform/Ansible), Apache Ranger management, Privacera access management, Starburst (Trino) platform operations, GitHub for configuration management, CI/CD pipeline implementation, incident management, troubleshooting, user/access management, service requests, platform health checks, Spark cluster operational support
Preferred skills
Dataiku, Vector DB
Technologies
Azure Databricks, ADLS, Confluent Kafka, Kubernetes, Terraform, Ansible, Apache Ranger, Privacera, Starburst (Trino), GitHub, Spark
Responsibilities
Monitor system performance and ensure high availability & reliability, Manage and support Apache Ranger, Experience supporting Starburst (Trino) platform operations and user access, Implement CI/CD pipelines and automate deployments, Experience in Building and maintaining scalable data platforms and pipelines (batch & streaming), Manage and support Apache Ranger, Knowledge of Privacera for access management and data governance, Experience supporting Starburst (Trino) platform operations and user access, Basic understanding of Spark clusters and distributed data processing for operational support and troubleshooting, Experience with GitHub for operational activities and configuration management
Seniority
Mid-Senior (4-8 years experience)