Data Engineer (DataLake) - All levels
Core
Design and implement reusable data ingestion and transformation pipelines within a Data Lake/Lakehouse implementation programme for financial services clients.
Role type
Intermediate/Senior Data Engineer (Data Lake)
Builds
Bronze, Silver, and Gold data layers; batch, CDC, and streaming data pipelines; governed data products.
Domain
Financial services (banking, payments, capital markets, wealth management, insurance, energy)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Databricks, Azure, SQL, Python/PySpark, ETL/ELT, Delta Lake, data modelling, data quality, CI/CD
Preferred skills
Asset management domain knowledge, fintech experience, regulated industry experience
Technologies
Databricks, Azure, Delta Lake, PySpark
Responsibilities
Develop batch, CDC, and streaming data ingestion pipelines; implement data cleansing, transformation, and standardisation; develop reusable data pipelines; implement data quality, reconciliation, validation, and monitoring controls; support data migration, integration testing, UAT, and production release; ensure solutions follow cloud, security, governance, and engineering standards.
Seniority
Intermediate/Senior, hands-on IC
