[C3A] Senior Data Platform Engineer (Microsoft Fabric)
Core
Design and build end-to-end medallion data architecture (Bronze/Silver/Gold Delta tables, Spark pipelines, Direct Lake models) for a risk analysis and scoring platform on Microsoft Fabric.
Role type
Senior Data Platform Engineer (Microsoft Fabric)
Builds
Production risk scoring data pipelines and semantic models for financial risk analysis
Domain
Financial services / Payments / Risk Analytics
Deliverable
production ML models
Required skills
Microsoft Fabric, Delta Lake internals, PySpark, Python (pandas, PyArrow, delta-rs), SQL performance tuning, Terraform
Preferred skills
PCI-scoped data platform experience, Financial services domain, Power BI/DAX, ClickHouse, OneLake shortcuts
Technologies
Microsoft Fabric, Delta Lake, PySpark, Python, Terraform, ClickHouse, PostgreSQL
Responsibilities
Design Bronze/Silver/Gold Delta table schemas with physical layout optimizations; Build Fabric Spark notebooks for feature pipelines; Author Silver adapters and canonical MERGE DAGs; Build Gold materialization pipelines for risk facts; Design Direct Lake semantic models; Configure OneLake namespaces and cross-workspace shortcuts; Establish idempotent Delta write patterns; Size Fabric capacity and partner on IaC.
Seniority
Senior, hands-on IC