Data Engineer
Core
Designing, building, and maintaining scalable data pipelines and infrastructure to support analytics and reporting use cases for a banking organization.
Role type
Senior Data Engineer (Cloud/Big Data)
Builds
End-to-end ETL/ELT data pipelines, in-house PySpark frameworks, and data infrastructure on Azure.
Domain
Banking / Financial Services / Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
PySpark, Python, SQL, Azure Databricks, Azure Data Factory, Azure SQL Server, Azure Storage, Azure DevOps, Git, PowerShell
Preferred skills
Power BI, automated testing, data pipeline monitoring
Technologies
Azure Cloud Services, Azure Databricks, Azure Data Factory, Azure SQL Server, Azure Storage, Azure DevOps, PySpark, Python, PowerShell
Responsibilities
Develop and enhance in-house PySpark frameworks; Build, test, and implement ETL/ELT data pipelines using Azure services; Provide mentorship to junior team members; Conduct exploratory data analysis and solution design; Monitor and support batch operations on the Data and Insights Platform.
Seniority
Senior, hands-on IC
