Senior Consultant Data Platforms Engineer - Databricks (Financial Services) (w/m/d)
Core
Design and implement AI-ready Lakehouse architectures and end-to-end data pipelines for financial services clients using Databricks.
Role type
Senior Data Platforms Engineer (Consulting)
Builds
Scalable data platforms, data models, and AI-ready architectures for banks, insurers, and asset managers.
Domain
Financial Services / Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
Data Engineering on Cloud Platforms, Databricks, PySpark, SQL, Data Governance, Data Security, Consulting, Solution Architecture, CI/CD, DataOps
Preferred skills
Azure, Kafka/Confluent, Event Hubs, REST-APIs, ADLS/S3, Power BI, Databricks SQL Warehouses, Databricks Workflows, Airflow, Azure Data Factory, FinOps, Data Lineage, SSO/SCIM, Network Isolation
Technologies
Databricks, Delta Lake, Medallion-Pattern, Data Mesh, Auto Loader, Delta Live Tables, PySpark, SQL, Kafka, Confluent, Event Hubs, ADLS, S3, Power BI, Databricks SQL Warehouses, Airflow, Azure Data Factory
Responsibilities
Conceptualize and implement AI-ready Lakehouse architectures with Delta Lake and Medallion-Pattern; Develop end-to-end data pipelines on Databricks using PySpark and SQL for batch and streaming; Integrate with upstream/downstream systems and orchestrate workflow monitoring; Define and configure Data Governance functionalities including security, privacy, and compliance; Collaborate with architects and product owners, document designs, and mentor junior engineers.
Seniority
Senior, hands-on IC with mentoring responsibilities