Databricks Data Engineer
Core
Lead the design and development of a modern, streaming-led data platform using Databricks medallion architecture for a large financial services organization.
Role type
Lead Databricks Data Engineer
Builds
End-to-end data vision, Databricks-based medallion architecture (Gold layer), and streaming ingestion pipelines
Domain
Financial services and pensions
Deliverable
production ML models | infrastructure
Required skills
Databricks, medallion architecture, streaming data ingestion, legacy data integration, technical decision-making, offshore team leadership
Preferred skills
Experience in regulated environments, translating business needs into technical delivery
Technologies
Databricks
Responsibilities
Define end-to-end data vision and target architecture; Lead design and development of Databricks-based medallion architecture; Improve data availability by shifting from batch to streaming; Act as senior technical decision-maker on data use cases; Work with onshore and offshore teams to unblock progress; Provide regular updates to senior stakeholders
Seniority
Lead, hands-on IC with strategic ownership
