Senior Consultant Data Platforms Engineer - Databricks (Financial Services) (w/m/d)
Core
Design and implement AI-ready Lakehouse architectures and end-to-end data pipelines for financial services clients using Databricks.
Role type
Senior Consultant Data Platforms Engineer (Databricks)
Builds
Scalable data platforms, data models, and AI-ready Lakehouse architectures for banks, insurers, and asset managers.
Domain
Financial Services / Data Engineering / Cloud Platforms
Deliverable
production ML models
Required skills
Data Engineering on Cloud Platforms, PySpark, SQL, Data Modeling, Data Governance, Data Security, Consulting, Technology Strategy, CI/CD, DataOps
Preferred skills
Azure, Kafka/Confluent, Event Hubs, REST-APIs, ADLS/S3, Power BI, Databricks SQL Warehouses, Databricks Workflows, Airflow, Azure Data Factory, FinOps, Data Lineage, SSO/SCIM, Network Isolation
Technologies
Databricks, Delta Lake, Medallion-Pattern, Data Mesh, Auto Loader, Delta Live Tables, Kafka, Confluent, Azure, PySpark, SQL, Power BI, Airflow
Responsibilities
Conceptualize and implement AI-ready Lakehouse architectures with Delta Lake and Medallion-Pattern; Develop end-to-end data pipelines on Databricks using PySpark and SQL; Integrate with upstream/downstream systems and orchestrate workflow monitoring; Define and configure Data Governance functionalities including security and compliance; Collaborate with architects and product owners, document designs, and mentor junior engineers.
Seniority
Senior, hands-on IC