Senior Data Engineer - AVP - OCBC
Core
Design and build scalable, reliable cloud-native data pipelines, lakehouse solutions, and real-time streaming systems for a major bank.
Role type
Senior Data Engineer
Builds
Cloud-native data pipelines, data lakehouse solutions, real-time streaming pipelines, automated ETL/ELT workflows
Domain
Banking / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Cloud-native data engineering, Apache Spark/PySpark, Apache Iceberg, streaming systems, SQL, Python, Unix/Linux shell scripting, data governance frameworks
Preferred skills
Experience with open data catalogue/governance frameworks (OpenMetadata, DataHub, Open Data Catalogue)
Technologies
Spark, PySpark, Iceberg, cloud-native streaming services, SQL, Python, Unix/Linux shell scripting
Responsibilities
Design and build scalable, reliable data pipelines using native cloud services; Implement data lakehouse solutions using Apache Iceberg; Develop and maintain real-time streaming pipelines; Participate in migration of complex SQL workloads to cloud-native architecture; Build end-to-end ETL/ELT workflows; Leverage open-source catalogue/governance solutions for lineage and metadata capture.
Seniority
Senior, hands-on IC
