Big Data Engineer for Business Data (all humans)
Core
Build and maintain a Databricks-based Data Lake and ETL pipelines to integrate data from local banks and group systems for business analytics and data science.
Role type
Senior Big Data Engineer
Builds
Databricks Data Lake, batch and streaming ETL pipelines
Domain
Banking, Cloud Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, Data Ingestion, Cloud Technologies, Data Quality (DQ), ETL Architecture
Preferred skills
Data Science collaboration, Streaming data integration
Technologies
Databricks, Cloud platforms
Responsibilities
Integrate and implement ETL processes for batch and streaming data; Contribute to Data Lake architecture design; Acquire data from local AT banks and CEE countries; Ensure data quality constraints; Support data lake consumers with analytics and data discovery.
Seniority
Senior, hands-on IC