CareerPlanSign in

Data Engineer

Sydney, Sydney Region💼 Full-time🗓 2026-05-21 → 2026-08-07

Core

Building and maintaining scalable, governed data pipelines and platform infrastructure to support intelligence products, analytics, and machine learning initiatives.

Role type

Senior hands-on Data Platform Engineer

Builds

Production-grade data pipelines, medallion architecture layers, and API integrations for the Property Risk Index and analytics platforms

Domain

Insurance / Financial Services / Cloud Data Engineering

Deliverable

production ML models | product features | infrastructure

Required skills

Data pipeline development, Medallion architecture, Advanced SQL, Python, Cloud data platforms (Databricks/Snowflake/Azure/AWS), REST API integration, Data governance, Agile delivery

Preferred skills

Azure Data Factory, AI/ML feature pipelines, Vector stores, Insurance domain experience

Technologies

Databricks, Snowflake, Azure Synapse, AWS Redshift, Azure Data Factory, Azure OpenAI

Responsibilities

Design and maintain scalable data pipelines from source systems; Develop and support medallion architecture layers; Monitor pipeline performance and data quality; Maintain documentation for pipelines and data lineage; Operate and support the data platform including environment management and access controls; Design and maintain API integrations; Enable machine learning initiatives by providing trusted datasets

Seniority

Senior, hands-on IC

Sourced via adzuna · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.