Senior Data Engineer
Core
Designing, building, and delivering end-to-end data solutions on the Microsoft cloud stack for a housing association.
Role type
Senior Data Engineer
Builds
Lakehouse and pipeline solutions from ingestion through to consumption
Domain
Housing / Microsoft Cloud Data Platform
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Microsoft Fabric, Azure data services (OneLake, Lakehouse, Warehouse, Dataflows Gen2, Pipelines, Synapse, SQL), ETL/ELT design, data modelling (star/snowflake schemas), Advanced SQL (joins, optimization, tuning), Python, PySpark, batch pipeline construction
Preferred skills
Legacy data migration (Dataverse, SQL)
Technologies
Microsoft Fabric, Azure, OneLake, Lakehouse, Warehouse, Dataflows Gen2, Pipelines, Synapse, SQL, Python, PySpark, Data Factory
Responsibilities
Designing and building lakehouse and pipeline solutions; executing ETL and ELT design; migrating or integrating legacy data sources into modern analytics architectures
Seniority
Senior, hands-on IC
