Databricks Data Engineer
Core
Design and build modern Lakehouse data platforms on Azure Databricks, implementing scalable batch and streaming pipelines to support analytics and ML workloads.
Role type
Senior Databricks Data Engineer
Builds
Lakehouse architectures, data pipelines, curated datasets, and semantic models for Power BI and data science.
Domain
Cloud Data Engineering (Azure Databricks, Apache Spark)
Deliverable
production ML models | product features
Required skills
Databricks, Apache Spark (PySpark), Python, SQL, Data Modeling (Star Schema), CI/CD, Azure Data Factory, Terraform
Preferred skills
Azure Data Lake, Unity Catalog, Data Governance, ML concepts, Microsoft Fabric
Technologies
Azure Databricks, PySpark, Delta Lake, Unity Catalog, Azure DevOps, GitHub Actions, Power BI, Terraform
Responsibilities
Design and implement Lakehouse architectures (medallion patterns, Delta Lake); Build robust batch and streaming data pipelines; Model data for analytics and data science; Ingest data from diverse sources; Apply data governance best practices; Set up CI/CD pipelines; Monitor and optimize cluster performance; Mentor colleagues and contribute to pre-sales.
Seniority
Senior, hands-on IC