Junior Data Engineer
Core
Design, develop, and maintain Microsoft Fabric data pipelines and data warehouses, integrating diverse data sources to support Power BI reporting and analytics.
Role type
Junior IC data engineer (Microsoft Fabric)
Builds
Batch and near-real-time data ingestion pipelines, medallion architecture data stores, and analytical datasets for Power BI
Domain
Data Engineering / Cloud Data Platform (Microsoft Fabric)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Microsoft Fabric (OneLake, Lakehouse, Warehouse, Data Pipelines, Dataflows Gen2), SQL Server/T-SQL, Python/PySpark, ETL/ELT, dimensional modelling, CI/CD, Git, REST/SOAP API integration
Preferred skills
Power BI integration, data quality monitoring, performance optimisation, schema evolution
Technologies
Microsoft Fabric, SQL Server, Python, PySpark, Azure DevOps, Git, Power BI
Responsibilities
Design and orchestrate reliable data ingestion pipelines from structured and unstructured sources; develop robust data transformation logic using SQL and Python; maintain scalable data architectures and medallion patterns; troubleshoot pipeline failures and optimise performance; support Power BI reporting requirements; implement CI/CD practices and security controls.
Seniority
Junior, hands-on IC