Data Engineer
Core
Design, build, and operate secure, reliable data pipelines and products within an emerging Enterprise Data Platform, partnering with data governance to deliver privacy-by-design ingestion and high-quality curated datasets.
Role type
Senior hands-on Data Engineer
Builds
Production-grade data pipelines, medallion architecture datasets (Bronze/Silver/Gold), and semantic models for Power BI
Domain
Public Sector (Queensland Government), Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
Microsoft Fabric (Pipelines, Dataflows Gen2, Notebooks/Spark, Lakehouse/OneLake, SQL Endpoints), Azure Data Services, SQL, PySpark, Microsoft Purview (scans, classifications, lineage), Medallion architecture, CI/CD, Infrastructure-as-Code
Preferred skills
Azure DevOps, Bicep/Terraform
Technologies
Microsoft Fabric, Azure Data Factory, Azure Synapse, Azure Databricks, Power BI, Azure DevOps, Bicep, Terraform
Responsibilities
Build and operate pipelines using Microsoft Fabric and Azure services; Implement medallion architecture and dimensional/semantic models; Execute metadata discovery in Microsoft Purview and apply classifications; Implement data quality checks and automated tests; Configure alerting, logging, and Operations dashboards; Work with data stewards and analysts to deliver prioritised use cases
Seniority
Senior, hands-on IC