Databricks Data Engineer | Senior
Core
Design, develop, and optimize scalable, high-performance data engineering solutions using the Databricks ecosystem to build modern Lakehouse architectures and implement Medallion data models.
Role type
Senior Databricks Data Engineer
Builds
Production-grade data pipelines, Lakehouse architectures, and data processing solutions
Domain
Cloud Data Engineering (Azure, Databricks)
Deliverable
production ML models
Required skills
PySpark, Spark SQL, Delta Lake, Azure Data Factory, Python, Unity Catalog, CI/CD, Git, Structured Streaming, Change Data Capture (CDC), Performance Tuning
Preferred skills
Delta Live Tables (DLT), Liquid Clustering, Auto Loader, Photon optimization, Workload optimization
Technologies
Databricks, PySpark, Spark SQL, Delta Lake, Azure Data Factory, Unity Catalog, Python, Git
Responsibilities
Design and implement scalable data architectures based on Lakehouse principles; Develop and maintain data pipelines using Databricks and PySpark; Implement data ingestion, processing, and integration solutions; Optimize data processing performance and infrastructure costs; Establish and maintain data governance and security standards; Act as a technical reference and mentor other professionals.
Seniority
Senior, hands-on IC with mentorship responsibilities