Azure Data Engineer 17668
Core
Design and maintain production-grade Azure Databricks data platforms, building scalable batch and streaming pipelines with bronze/silver/gold architectures.
Role type
Senior Azure Databricks Data Engineer
Builds
Production-grade data platforms, scalable batch and streaming pipelines
Domain
Cloud data engineering, Azure ecosystem, Big Data
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
Azure Databricks, Apache Spark (PySpark/Scala), Delta Lake, Unity Catalog, Azure Data Factory/Synapse, CI/CD automation, Spark performance tuning
Preferred skills
Experience with service principals and managed identities, knowledge of ACID transactions and incremental processing patterns
Technologies
Azure Databricks, Apache Spark, PySpark, Scala, Delta Lake, Unity Catalog, Azure ADLS, Azure Data Factory, Azure Synapse, Azure DevOps, GitHub Actions
Responsibilities
Develop and maintain production-grade Azure Databricks data platforms, Build scalable batch and streaming data pipelines, Design and implement bronze/silver/gold data architectures, Implement and optimize Delta Lake capabilities, Configure governance, permissions, lineage, and auditability using Unity Catalog, Perform Spark performance tuning and optimization activities
Seniority
Senior, hands-on IC
