Azure Data Engineer - Synapse & Big Data Specialist
Core
Design and develop ETL/ELT pipelines, build SQL scripts and PySpark notebooks, and optimize data processing on Azure Synapse Analytics and Azure Data Lake Gen2.
Role type
Senior Azure Data Engineer (Synapse & Big Data)
Builds
Robust data pipelines and data solutions for business stakeholders
Domain
Cloud data engineering (Azure Synapse, Data Lake Gen2, PySpark)
Deliverable
production ML models
Required skills
Azure Synapse Analytics, SQL (stored procedures, optimization), PySpark, Azure Data Lake Gen2, GitHub version control, data modeling, real-time data processing
Preferred skills
Azure certifications, data governance frameworks, CI/CD pipeline implementation
Technologies
Azure Synapse Analytics, Azure Data Lake Gen2, PySpark, SQL, GitHub
Responsibilities
Design and develop ETL/ELT pipelines, Build and maintain SQL scripts and PySpark notebooks, Optimize performance of SQL Dedicated Pools and Azure Data Lake Gen2, Manage version control using GitHub branching strategies, Handle real-time data processing workflows, Write comprehensive technical documentation
Seniority
Mid-to-Senior, hands-on IC