ADF Data Engineer
Core
Design, build, and maintain ETL/ELT pipelines in Microsoft Fabric to aggregate, harmonize, and normalize data for data science, analytics, and reporting.
Role type
Senior Data Engineer (Microsoft Fabric/Azure)
Builds
Production-ready data pipelines, model-ready datasets, and validated data solutions within Microsoft Fabric and Azure.
Domain
Cloud Data Engineering (Microsoft Fabric, Azure, Snowflake)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Microsoft Fabric (Dataflows Gen2, Lakehouse, Data Factory, Notebooks, Spark), Python/PySpark, SQL, ETL/ELT pipeline design, data modeling, data quality validation, CI/CD (Git, Azure DevOps)
Preferred skills
Power BI, Azure data services
Responsibilities
Design and maintain ETL/ELT pipelines; aggregate and normalize data from multiple sources; develop data transformation logic using Python/PySpark; resolve data quality issues and trace errors to sources; establish automated data validation and monitoring; create model-ready datasets for data science workflows; document data lineage and transformation logic; support CI/CD processes.
Seniority
Senior, hands-on IC