Azure Data Engineer
Core
Designing and implementing scalable cloud data engineering solutions, data warehousing, and data lakes on Azure.
Role type
Senior Azure Data Engineer
Builds
Scalable data pipelines, data lakes, and data warehouse solutions
Domain
Cloud data engineering, Azure ecosystem
Required skills
Azure Data Factory, Azure Databricks, PySpark, Scala, Azure Functions, Logic Apps, Azure DevOps, CI/CD pipelines, SQL, data transformation, data security, authentication, authorization
Preferred skills
Event Hub, Stream Analytics, HDInsight, NoSQL databases, data governance, hybrid data environments, cloud migration
Technologies
Azure Data Factory, Azure Databricks, PySpark, Scala, Azure Functions, Logic Apps, Azure DevOps, Event Hub, Stream Analytics, HDInsight, SQL
Responsibilities
Design and develop scalable Azure data engineering solutions; Develop data pipelines using Azure Data Factory; Work with Azure Functions, Logic Apps, Triggers, and Integration Runtime; Develop data processing solutions using Azure Databricks, PySpark, and Scala; Design and implement Azure data lake and data warehouse solutions; Build and manage CI/CD pipelines using Azure DevOps; Implement data security, authentication, and authorization mechanisms; Troubleshoot data pipeline and production issues; Collaborate with architects, developers, business stakeholders, and client teams; Maintain technical documentation and follow SDLC and development best practices.
Seniority
Senior, 5–15 years hands-on experience