CareerPlan

Lead Data Engineer

Sydney, New South Wales, AUFull-time2026-10-31 → 2026-11-10

Core

Design, build, and optimize scalable cloud data platforms and analytics pipelines.

Role type

Lead Data Engineer

Builds

Cloud data platforms, analytics pipelines, and data warehouse solutions

Domain

Cloud Data Engineering / Data Warehousing

Deliverable

production ML models

Required skills

Amazon Redshift, Fivetran, Databricks, Apache Spark, Delta Lake, dbt, SQL, Python, Git, CI/CD

Preferred skills

AWS services (S3, IAM, Glue, Lambda, CloudWatch), data cataloging, Apache Airflow, AWS/Databricks/dbt certifications

Technologies

Amazon Redshift, Fivetran, Databricks, Spark, Delta Lake, dbt, Python, AWS, Git, Airflow

Responsibilities

Design and maintain batch and streaming data pipelines; Build and optimize Amazon Redshift data warehouse solutions; Configure and manage Fivetran connectors; Develop scalable data processing workflows in Databricks; Create modular transformation models using dbt; Implement data quality checks and governance controls; Partner with stakeholders to translate requirements into data products; Troubleshoot pipeline failures and improve platform reliability.

Seniority

Lead, hands-on IC with mentorship