Data Engineer - AWS
Core
Build and maintain data pipelines and products for ASX's core market data assets, enabling stakeholders to access, understand, and share data for financial market operations.
Role type
Senior Data Engineer (AWS)
Builds
Data ingestion pipelines, curated data products (files, reports, dashboards, APIs), and real-time streaming solutions for financial market infrastructure.
Domain
Financial Markets / Data Engineering
Required skills
AWS services (Glue, Athena, RedShift, DataZone, Kafka), Python, Spark, Terraform/Terragrunt, Airflow, Apache Iceberg, Data modeling, DevSecOps, Data visualization (Tableau/Power BI/QuickSight)
Preferred skills
Real-time streaming architecture, Data product design, Agile methodologies
Technologies
AWS, Confluence Kafka, Airflow, Apache Iceberg, Athena, RedShift, DataZone, Tableau, Power BI, QuickSight, Python, Spark, Terraform, Terragrunt
Responsibilities
Collaborate with stakeholders to understand data objectives and champion central data platform usage; Ingest and curate core data assets into source-aligned data products; Design and build data pipelines within critical market infrastructure; Drive adoption of data engineering standards, frameworks, and best practices; Ensure data products are consumable via files, reports, dashboards, and APIs.
Seniority
Senior, hands-on IC
