Senior Data Engineer
Core
Design, develop, and support trusted data products and enterprise data platforms for climate, energy, and water management decisions.
Role type
Senior IC data engineer (Microsoft Fabric)
Builds
Modern data ingestion pipelines, transformation processes, Lakehouses, and Warehouses using Medallion architecture
Domain
Public sector (NSW Government) / Climate, Energy, Water
Required skills
Microsoft Fabric, Python, PySpark, SQL, ETL/ELT, Delta Lake, Medallion architecture, Azure, Azure DevOps
Preferred skills
Data mesh principles, platform governance, automation, incident resolution
Technologies
Microsoft Fabric, Python, PySpark, SQL, Delta Lake, Azure, Azure DevOps
Responsibilities
Design and deliver modern data ingestion pipelines; Build robust transformation processes; Develop reliable data products with strong controls; Monitor pipeline performance and resolve issues; Support and operate the enterprise data platform; Implement and improve platform governance and automation
Seniority
Senior, hands-on IC