Senior Microsoft Fabric Data Engineer - Manager - Data & AI - Technology Consulting - Advisory
Core
Design, develop, and deliver enterprise-grade Microsoft Fabric data platforms, including end-to-end implementation of data ingestion, transformation, governance, and operational support for reporting, analytics, and AI workloads.
Role type
Senior Microsoft Fabric Data Engineer (Manager level)
Builds
Enterprise-scale data platforms on Microsoft Fabric (OneLake, Lakehouse, Warehouse, Data Factory, Dataflows Gen2, Real-Time Intelligence, Power BI, Semantic Models)
Domain
Cloud Data Engineering & AI
Required skills
Microsoft Fabric ecosystem (OneLake, Lakehouse, Warehouse, Data Factory, Dataflows Gen2, Real-Time Intelligence, Power BI, Semantic Models), SQL, Python, PySpark, ETL/ELT, Medallion Architecture, CI/CD, Data Governance, Azure DevOps, Git
Preferred skills
Spark optimization, Streaming data architectures, Generative AI data foundations, Data quality frameworks
Technologies
Microsoft Fabric, OneLake, Data Factory, Dataflows Gen2, Power BI, Azure DevOps, Git, PySpark, SQL
Responsibilities
Design and maintain scalable Lakehouse, Warehouse, and Medallion Architecture patterns; Build and optimise data ingestion frameworks; Develop reusable ingestion patterns and accelerators; Integrate structured, semi-structured, and streaming data into OneLake; Develop and optimise Spark, PySpark, and SQL-based transformation pipelines; Implement data governance standards, metadata management, and security controls; Establish CI/CD pipelines and automated deployment processes; Monitor platform performance and troubleshoot complex issues.
Seniority
Senior, hands-on IC with management responsibilities