Data Engineer
Core
Designing, building, and maintaining scalable data pipelines and business intelligence solutions using Azure cloud services.
Role type
Senior Data Engineer
Builds
End-to-end data pipelines, scalable data solutions, dashboards, and reports
Domain
Cloud data engineering and business intelligence
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Azure Data Factory, SQL Server, Power BI, Azure Synapse Analytics, Databricks, Microsoft Fabric, Python, PySpark, PowerShell, Power Automate, data warehousing concepts, data modelling, performance tuning
Preferred skills
Azure Data Lake Storage (ADLS), Delta Lake, DevOps, CI/CD pipelines, version control systems (Git)
Technologies
Azure Data Factory, SQL Server, Power BI, Azure Synapse Analytics, Databricks, Microsoft Fabric, Python, PySpark, PowerShell, Power Automate, Azure Data Lake Storage (ADLS), Delta Lake, Git
Responsibilities
Design, develop, and manage end-to-end data pipelines using Azure Data Factory; Develop, deploy, and monitor scalable data solutions using Azure Synapse Analytics / Databricks / Microsoft Fabric; Write optimized SQL Server scripts, stored procedures, and views; Build and maintain insightful dashboards and reports using Power BI; Develop automation scripts using PowerShell; Create automated workflows using Power Automate; Leverage Python / PySpark for data manipulation and orchestration; Perform root cause analysis, data validation, and ensure data integrity; Participate in code reviews, design discussions, and documentation efforts; Ensure security, compliance, and governance in data engineering activities
Seniority
Senior, hands-on IC