Senior Data Engineer / Consultant - Databricks
Core
Design, build, deploy, and optimise scalable Databricks and Azure-based data platforms and pipelines for enterprise clients.
Role type
Senior Data Engineer / Consultant
Builds
Production data pipelines, Lakehouse and data warehouse environments, and modern Databricks solutions
Domain
Data Engineering, Cloud (Azure), Databricks
Deliverable
production ML models
Required skills
Python, PySpark, SQL, Databricks, Delta Lake, Medallion Architecture, Unity Catalog, Git, CI/CD, Data Modeling, Stakeholder Engagement
Preferred skills
Microsoft Fabric, Azure Data Platform, Databricks Certification
Technologies
Databricks, Azure, Microsoft Fabric, Delta Lake, Unity Catalog, Git, Azure Data Factory, Apache Airflow
Responsibilities
Design and build production data pipelines; Develop data transformations using Python, PySpark, and SQL; Implement governance and security practices; Build automated deployment processes; Lead technical discussions and translate business requirements; Mentor junior engineers; Contribute to engineering frameworks and standards.
Seniority
Senior, hands-on IC with consulting responsibilities