Senior Data Engineer - AVP
Core
Design and build scalable, reliable cloud-native data pipelines and real-time streaming solutions for a major bank's data lakehouse.
Role type
Senior IC data engineer (cloud-native & streaming)
Builds
Cloud-native data pipelines, data lakehouse solutions (Apache Iceberg), real-time streaming systems, automated ETL/ELT workflows
Domain
Financial services / Banking
Required skills
Cloud-native data engineering, Apache Spark/PySpark, Apache Iceberg, real-time streaming, Python, SQL, Unix/Linux shell scripting, open data catalogue/governance frameworks
Preferred skills
Experience migrating legacy SQL workloads to cloud-native architecture, experience with OpenMetadata/DataHub
Technologies
Spark, PySpark, Iceberg, Unix/Linux shell scripting, Python, SQL, Git
Responsibilities
Design and build scalable, reliable data pipelines using native cloud services; Implement data lakehouse solutions using Apache Iceberg; Develop and maintain real-time streaming pipelines; Build end-to-end ETL/ELT workflows; Write efficient SQL for complex data transformations; Develop automated data quality checks and operational monitoring
Seniority
Senior, hands-on IC
