Senior Data Engineer
Core
Build and support scalable data pipelines connecting Cards Modernisation, commbank.data, and Collections platforms.
Role type
Senior Data Engineer
Builds
Scalable data solutions for banking and collections data requirements
Domain
Financial Services / Banking / Payments
Deliverable
production ML models | product features
Required skills
Snowflake, PySpark, Python, Advanced SQL, AWS, S3, Data Pipelines, ETL/ELT, Data Modelling, Data Quality & Reconciliation, CI/CD
Preferred skills
EMR / EMR Serverless, AWS Step Functions, AWS Lambda, Cards or Payments Domain Experience, Banking Experience, Exposure to PowerCurve Collections (PCC)
Responsibilities
Develop and maintain data pipelines using Snowflake, PySpark, and Python; Build data transformations and models to support Collections data requirements; Work with AWS services and S3 for data ingestion and processing; Develop and optimize SQL queries and data workflows; Implement data quality checks, reconciliations, and monitoring processes; Support ETL/ELT development and production deployments; Troubleshoot and resolve data-related issues in production environments; Participate in code reviews, testing, and CI/CD practices
Seniority
Senior, hands-on IC
