Data Engineer - AWS
Core
Build and maintain AWS-based data pipelines, ingestion, curation, and distribution for ASX's core market data assets to enable data access and analytics for financial market stakeholders.
Role type
Senior Data Engineer (AWS)
Builds
Data products (files, reports, dashboards, APIs) and real-time streaming pipelines for financial market data
Domain
Financial Markets / Data Engineering
Required skills
AWS services (Glue, Athena, RedShift, DataZone, Kafka), Python, Spark, Terraform/Terragrunt, Airflow, Apache Iceberg, Data modeling, DevSecOps, Tableau/Power BI/QuickSight
Preferred skills
Real-time streaming architecture, Data product design, Agile methodologies
Technologies
AWS, Kafka, Airflow, Apache Iceberg, Athena, RedShift, DataZone, Python, Spark, Terraform, Terragrunt, Tableau, Power BI, QuickSight
Responsibilities
Collaborate with stakeholders to understand data objectives and champion central data platform usage; Ingest and curate core data assets into source-aligned data products; Design and build data pipelines within critical market infrastructure; Drive adoption of data engineering standards, frameworks, and best practices; Ensure data products are designed for persistent product teams to run in production.
Seniority
Senior, hands-on IC
