Intermediate Data Engineer
Core
Design, develop, and maintain scalable data pipelines and architectures using Microsoft Fabric, SQL Server, and Python/PySpark to support Power BI and downstream analytics.
Role type
Intermediate Data Engineer
Builds
Production ETL/ELT pipelines, data warehouses, and analytical datasets
Domain
Data Engineering, Cloud Data Platforms (Microsoft Fabric/Azure)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Microsoft Fabric (OneLake, Lakehouse, Warehouse, Dataflows Gen2), SQL Server/T-SQL, Python/PySpark, ETL/ELT, Dimensional Modelling, CI/CD, Data Quality Monitoring
Preferred skills
REST/SOAP API integration, Schema Evolution, Power BI integration, Infrastructure Optimization
Technologies
Microsoft Fabric, SQL Server, Python, PySpark, Azure DevOps, Git, Power BI
Responsibilities
Design and orchestrate batch and near-real-time data ingestion pipelines; Develop robust data transformation logic using SQL and Python; Manage schema evolution and data warehousing patterns; Troubleshoot pipeline failures and optimize performance; Collaborate with stakeholders to define requirements and deliver solutions.
Seniority
Intermediate, hands-on IC
