CareerPlan

Data Engineer

Sydney, New South WalesFull-time$31200k–$62400k2026-11-13 → 2026-11-16
Hybrid

Core

Build governed data platforms on AWS and/or Databricks to support analytics, machine learning, and generative AI.

Role type

Senior Data Engineer / Data Engineering Lead / Senior Data Engineering Lead

Builds

Batch and streaming pipelines, ETL/ELT frameworks, data platforms on warehouse and lakehouse

Domain

Financial services / Cloud data engineering

Deliverable

production ML models

Required skills

SQL, Python, Spark, AWS (Glue, Redshift, Athena, MSK, MWAA, Lake Formation), Databricks (Unity Catalog, Delta Lake), IaC, CI/CD

Preferred skills

Kafka, Flink, Airflow, dbt, RAG retrieval layers, AWS/Databricks/dbt/Snowflake certifications

Technologies

AWS, Databricks, SQL, Python, Spark, Glue, Redshift, Athena, MSK, MWAA, Lake Formation, Unity Catalog, Delta Lake, Iceberg, Kafka, Flink, Airflow, dbt

Responsibilities

Build and optimise batch and streaming pipelines; Deliver data platforms on AWS and/or Databricks; Model data for real query patterns; Build data quality, lineage, access control and FinOps; Lead a workstream and grow a team (Lead level and above)

Seniority

Senior (3-6 years), Lead (6-10 years), Senior Lead (10-15 years)