Azure Data Engineer - Synapse & Big Data Specialist
Core
Design and develop ETL/ELT pipelines, build SQL scripts and PySpark notebooks, and optimize data processing on Azure Synapse Analytics and Azure Data Lake Gen2.
Role type
Senior Azure Data Engineer (Synapse & Big Data)
Builds
Real-time data processing workflows and robust data pipelines
Domain
Cloud data engineering, Azure ecosystem
Deliverable
production ML models | product features
Required skills
Azure Synapse Analytics, SQL (stored procedures, optimization), PySpark, Azure Data Lake Gen2, GitHub version control, data modeling, real-time data processing
Preferred skills
Azure certifications, data governance frameworks, CI/CD pipeline implementation
Technologies
Azure Synapse Analytics, SQL, PySpark, Azure Data Lake Gen2, GitHub
Responsibilities
Design and develop ETL/ELT pipelines, Build and maintain SQL scripts and PySpark notebooks, Optimize performance of SQL Dedicated Pools and Azure Data Lake Gen2, Model data across different storage systems, Manage version control using GitHub branching strategies, Handle real-time data processing workflows
Seniority
Senior, hands-on IC
