Data Platform MS Fabric Databricks
Core
Extend an existing banking data platform by integrating new datasets and deploying data flows using established patterns, standards, and CI/CD processes.
Role type
Senior Data Engineer (Banking Data Platform)
Builds
Data pipelines, datasets, and data models for a banking environment
Domain
Banking / Financial Services / Data Engineering
Required skills
PySpark, SQL, Databricks, Delta Lake, Unity Catalog, Data Modeling (Dimensions/Facts/SCD), Azure DevOps, CI/CD pipelines, TOML configuration
Preferred skills
Microsoft Fabric, Terraform, Kafka, Spark Declarative Pipelines, Databricks Asset Bundles, Change Data Feed, Auto CDC, Kimball methodology
Technologies
Databricks, Microsoft Fabric, Azure DevOps, PySpark, SQL, Delta Lake, Unity Catalog, TOML, Terraform, Kafka
Responsibilities
Integrate new datasets into the existing data platform; Configure new data flows according to established patterns and standards; Develop and adapt data processing logic using PySpark and SQL; Define data modeling structures (dimensions, facts, granularity, keys, SCD types, snapshots); Validate data against quality rules and contracts; Diagnose and resolve integration anomalies and deployment failures; Understand functional banking data sources (Core Banking, Private Banking) to ensure correct integration.
Seniority
Senior, hands-on IC