CareerPlanSign in

Solution Designer / Lead Data Engineer

Sydney, New South Wales💼 Full-time🗓 2026-09-17 → 2026-09-26

Core

Architect and lead the end-to-end design of a modern, scalable, automated enterprise Data Ingestion framework transitioning legacy systems to real-time, event-driven cloud workflows.

Role type

Senior Solution Designer / Lead Data Engineer

Builds

Modular, cloud-agnostic data patterns for batch and streaming data across multi-cloud and hybrid environments

Domain

Enterprise Data Engineering / Multi-Cloud Architecture

Deliverable

production ML models | product features

Required skills

Multi-cloud data platform design, Solution Architecture, Ingestion patterns (batch, CDC, streaming), Distributed data tools (Spark, Airflow, Kafka, Snowflake, BigQuery), SQL & Data Modeling, Python/Scala/Java, Infrastructure as Code (Terraform), CI/CD pipelines

Preferred skills

dbt, Apache Iceberg/Delta Lake, Enterprise data catalog frameworks, Regulatory compliance knowledge

Technologies

GCP, AWS, Azure, Apache Spark, Airflow, Kafka, Pub/Sub, Kinesis, Snowflake, BigQuery, Redshift, Terraform

Responsibilities

Author comprehensive Solution Design Documents (SDDs) and architectural blueprints; Provide technical leadership for high-throughput data pipeline engineering; Design secure ingestion interfaces connecting on-premises and SaaS sources to cloud data lakes; Embed automated data quality checks, lineage tracking, and governance controls; Optimize pipeline latency, availability, and multi-cloud costs

Seniority

Senior, hands-on IC with architectural leadership

Sourced via viewjobs · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.