Principal Software Engineer (Data Platform)
Core
Design and develop scalable ETL/ELT pipelines and data transformation solutions on Microsoft Azure.
Role type
Senior Azure Data Engineer
Builds
Scalable data solutions, Data Lakehouse architectures, and integrated data pipelines
Domain
Cloud Data Engineering (Microsoft Azure)
Required skills
Azure Data Factory, Azure Databricks, PySpark, Spark SQL, Delta Lake, Azure Synapse Analytics, Azure Event Hub, Azure Data Lake Storage Gen2, Azure Logic Apps, Azure Function Apps, Azure SQL Database, Azure Key Vault
Preferred skills
Microsoft SharePoint Integration, Data Lakehouse Architecture
Responsibilities
Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks; Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake; Build and maintain Data Lakehouse solutions using ADLS Gen2; Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing; Implement secure integrations using Azure Key Vault and SharePoint; Troubleshoot and optimize data pipelines and Spark workloads.
