Data Engineer
Core
Design, build, and operate scalable data pipelines and medallion architecture to transform complex data into consumable assets for analytics, reporting, and AI use cases within an enterprise-scale Microsoft Fabric platform.
Role type
Senior Data Engineer
Builds
End-to-end data ecosystem including ingestion, transformation, semantic models, and data assets for Finance, People, Procurement, and Assets domains.
Domain
Public sector (City Council) / Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
SQL, PySpark, Python, PowerShell, data modeling, API integration, SFTP, ERP data handling, cloud storage management, test-driven development
Preferred skills
Power BI, Tableau, OAuth2/Entra identity management, Microsoft Data certifications (DP-600, DP-700)
Technologies
Microsoft Fabric, Azure, V-Order, Delta Optimisation
Responsibilities
Design and operate scalable data pipelines aligned with medallion architecture; co-design data governance frameworks and engineering standards; monitor and optimize pipeline performance; troubleshoot production pipelines; consult with stakeholders to co-design semantic data models; drive continuous improvement in engineering practices.
Seniority
Senior, hands-on IC
