Senior Azure Databricks Engineer
Core
Architecting and implementing scalable enterprise data platforms and Lakehouse solutions using Azure Databricks, Delta Lake, and Unity Catalog.
Role type
Senior IC Azure Databricks Engineer
Builds
Enterprise data platforms, data engineering frameworks, and Lakehouse architectures
Domain
Cloud Data Engineering / Big Data
Required skills
Azure Databricks, Apache Spark (PySpark/SQL), Unity Catalog, Delta Lake, Azure Data Lake Storage Gen2, Python, SQL, CI/CD (Azure DevOps), Data Governance, Security Architecture (RBAC, Managed Identities)
Preferred skills
Dimensional modeling, Data Vault, Medallion architecture, Performance tuning, Cost management
Technologies
Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, Azure DevOps, Azure Monitor, Log Analytics, Application Insights, Microsoft Entra ID, Key Vault
Responsibilities
Architect and implement scalable enterprise data platform solutions; Design and develop data engineering frameworks for batch, streaming, and real-time analytics; Administer and maintain Azure Databricks workspaces, clusters, and governance; Define and implement enterprise security architecture; Establish data governance standards for lineage, quality, and metadata; Optimize Databricks workloads and manage costs; Develop monitoring, logging, and operational dashboards; Support migration of legacy data warehouses to modern Lakehouse architecture; Troubleshoot production incidents.
Seniority
Senior, hands-on IC