Staff Data Engineer
Core
Design and optimize enterprise data pipelines for collections use cases, modeling card and account data within the Snowflake and PySpark architecture.
Role type
Staff Data Engineer (Collections)
Builds
Production data pipelines, data models, and observability controls for collections/lending use cases.
Domain
Financial services / Collections / Payments
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
Snowflake, PySpark, Python, Advanced SQL, AWS, S3, ETL/ELT, Data modelling, Data quality, CI/CD
Preferred skills
EMR, Step Functions, Lambda, Cards data, Collections data, PowerCurve Collections
Responsibilities
Design Collections Snowflake and PySpark architecture; Lead integration with commbank.data; Model HPS card and account data; Define data contracts and schema-evolution standards; Establish automated data-quality and reconciliation controls; Design restartable, idempotent and recoverable pipelines; Optimise Snowflake and PySpark workloads; Establish production monitoring and data-pipeline observability; Lead technical reviews and complex data investigations; Mentor Senior Data Engineers and Data Engineers; Work closely with Cards MOD, PCC and platform teams.
Seniority
Staff, hands-on IC with mentorship
