Senior Data Engineer
Core
Own the Azure Databricks platform, set engineering standards, and lead the data migration of a core lending system.
Role type
Senior IC data engineer (cloud data platform)
Builds
Azure Databricks platform, ELT pipelines, dimensional data models
Domain
Fintech / Lending
Deliverable
production ML models
Required skills
Azure Databricks, Python, SQL, CI/CD, dimensional modelling, code review
Preferred skills
Core system migration leadership
Technologies
Azure Databricks, Spark, Delta Lake, Unity Catalog, Azure DevOps, GitHub, Databricks Asset Bundles
Responsibilities
Own data platform roadmap and engineering standards; Design and lead robust, scalable ELT pipelines; Lead data workstream for core lending platform migration; Build and extend curated, dimensional data model; Lift data quality, freshness and alerting; Keep platform cost-efficient through cluster optimisation; Mentor and develop other data engineers; Partner with analysts, data scientists, product managers and Engineering
Seniority
Senior, hands-on IC