Senior Data Engineer - ATP
Core
Designing, building, and supporting high-performance data pipelines and solutions on UNSW's enterprise data platform to enable business intelligence, planning, and official government reporting.
Role type
Senior Data Engineer (Platform & Architecture)
Builds
Large-scale data ingestion, storage, processing, orchestration, and infrastructure on Microsoft Azure and Databricks.
Domain
Higher Education / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Data engineering, data modelling, DevOps, SQL, Python/PySpark, Unity Catalog, Azure data services, CI/CD automation, Kimball methodology, Snowflake schema, SCD, data governance, security controls, Terraform, Git, JIRA, Confluence.
Preferred skills
Higher Education data frameworks (TEQSA, TCSI, QILT), student admission data transformation, Agile Project Management, storyboarding, estimation.
Technologies
Microsoft Azure, Databricks, Unity Catalog, Azure DevOps, Terraform, Snowflake, AWS Cloud, Git, JIRA, Confluence.
Responsibilities
Lead technical development and mentor a high-performing team across analytics and platform services; design and implement scalable data platform architecture; provide technical guidance for admissions dashboards and reports; manage complex risks, issues, and financials; evaluate and implement new technologies for data ingestion and processing; optimize data pipeline and dashboard efficiency.
Seniority
Senior, hands-on IC with mentorship responsibilities
