Azure Data Engineer Synapse Big Data Specialist
Core
Design and develop ETL/ELT pipelines, build SQL scripts and PySpark notebooks, and optimize data processing on Azure Synapse Analytics and Data Lake Gen2.
Role type
Senior Azure Data Engineer (Synapse & Big Data)
Builds
Real-time data processing workflows and robust data pipelines for business stakeholders
Domain
Cloud Data Engineering (Azure Synapse, Data Lake Gen2)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Azure Synapse Analytics, SQL (stored procedures, optimization), PySpark, Azure Data Lake Gen2, GitHub version control, data modeling, real-time data processing
Preferred skills
Azure certifications, data governance frameworks, CI/CD pipeline implementation
Technologies
Azure Synapse Analytics, PySpark, SQL, Azure Data Lake Gen2, GitHub
Responsibilities
Design and develop ETL/ELT pipelines, Build and maintain SQL scripts and PySpark notebooks, Optimize performance of SQL Dedicated Pools and Azure Data Lake Gen2, Model data across different storage systems, Manage version control using GitHub branching strategies, Handle real-time data processing workflows, Write comprehensive technical documentation
Seniority
Mid-to-Senior, hands-on IC