W2PE - Engineer
Core
Build and refactor scalable, metadata-driven ETL pipelines in Microsoft Fabric to modernize enterprise data architecture and enable faster reporting.
Role type
Senior IC Fabric Data Engineer
Builds
Production data pipelines and medallion architecture (Bronze, Silver, Gold) in Microsoft Fabric
Domain
Data Engineering / Cloud Analytics (Microsoft Fabric)
Required skills
Python (PySpark), Microsoft Fabric, Medallion Architecture, Metadata-driven ETL, SQL, Cloud Analytics (Azure)
Preferred skills
Azure Data Factory migration, Power BI, Microsoft Fabric certifications, Consulting experience
Technologies
Microsoft Fabric, Python, PySpark, Azure, SQL
Responsibilities
Design and maintain metadata-driven data pipelines; Implement Bronze, Silver, and Gold layers; Develop parameterized Python notebooks for parallel processing; Ensure data quality and validation at each layer; Document architecture and transfer knowledge to the existing team.
Seniority
Senior, hands-on IC