Data Engineer
Core
Design, build, and optimize large-scale data processing solutions and ETL/ELT workflows within a global banking environment.
Role type
Senior Data Engineer
Builds
Scalable data pipelines and high-performance data processing solutions
Domain
Banking / Big Data
Deliverable
production ML models
Required skills
PySpark, Python, Azure Data Factory, Spark SQL DataFrames, ETL/ELT Development, Data Pipeline Design, SQL Data Modelling, Performance Tuning, Distributed Data Processing
Preferred skills
Azure Databricks, Microsoft Azure, CI/CD Pipelines, Data Lake/Lakehouse Architectures
Technologies
PySpark, Python, Azure Data Factory, Spark SQL, Azure Databricks, Microsoft Azure
Responsibilities
Design and develop scalable data pipelines, Build and optimize ETL/ELT workflows, Develop high-performance data processing solutions, Work with structured and unstructured datasets, Develop and orchestrate pipelines using Azure Data Factory, Optimize Spark jobs and distributed processing workloads, Troubleshoot data processing bottlenecks
Seniority
Senior, hands-on IC
