Data Engineer
Core
Building reliable, timely, and usable data foundations for customer reporting, models, and AI applications by connecting source systems and creating robust data pipelines.
Role type
Senior Data Engineer (Microsoft Cloud)
Builds
Data pipelines, Lakehouses, Warehouses, and star schemas using Microsoft Fabric, Azure Databricks, and Azure Data Factory.
Domain
Data Engineering / Microsoft Cloud
Deliverable
production ML models
Required skills
SQL, Python, PySpark, Data Modeling (Star Schema, 3NF), CI/CD, Git, Azure DevOps, Cost Optimization, Troubleshooting
Preferred skills
Microsoft Fabric, Azure Synapse Analytics, Microsoft Purview, Data Quality Frameworks, Real-Time Intelligence (Eventhouse, KQL), DP-700 Certification, Agentic AI
Technologies
Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure SQL, Dataverse, SAP, Azure Synapse Analytics, Azure DevOps, Git
Responsibilities
Uncover source systems and build reliable, restartable load processes; Build data pipelines and notebooks in Microsoft Fabric, Azure Data Factory, and Azure Databricks; Set up Lakehouses and Warehouses in Fabric following a medallion architecture; Model data into performant star schemas for Power BI consultants; Manage customer environments in Azure DevOps or Git including deployment scripts and CI/CD pipelines; Monitor, optimize, and troubleshoot existing pipelines for duration, reliability, and cost; Document solutions and establish naming conventions for handover; Mentor junior colleagues via code reviews and pair programming.
Seniority
Mid-Senior (3-6 years experience)