Azure Data Engineer(Senior)
Core
Design and implement scalable, secure, and high-performance data architectures on Azure, focusing on ELT/ETL pipelines, data ingestion, transformation, and storage solutions.
Role type
Senior Azure Data Engineer (Consultant/Manager)
Builds
Scalable data architectures, ETL/ELT pipelines, data ingestion and transformation solutions, and real-time processing workflows on Azure.
Domain
Cloud Data Engineering (Azure ecosystem)
Deliverable
production ML models | product features | infrastructure
Required skills
Azure Data Factory (ADF), Databricks, Pyspark, SQL, Azure Functions, Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Delta Live Tables, Event Hubs, Stream Analytics, GitHub Actions, Azure DevOps, Data Modeling, Data Integration, Data Manipulation, Key Vault, Azure Monitor, Log Analytics
Preferred skills
Project management, Scrum team leadership, External technical ecosystem exposure, Azure Certifications (Data Engineer Associate, Solutions Architect), Databricks Certification, Experience in regulated environments
Technologies
Azure, Databricks, Synapse Analytics, Delta Live Tables, Event Hubs, Stream Analytics, Key Vault, ADLS, SQL Server, Fabric, GitHub, Azure DevOps
Responsibilities
Design and optimize ETL/ELT data pipelines; Implement data ingestion, transformation, and storage solutions; Develop batch and real-time data processing solutions; Ensure data quality, governance, and security; Deploy data solutions using CI/CD pipelines; Troubleshoot and optimize data workflows for scalability and performance; Mentor data engineers and analysts; Provide technical direction and design reviews.
Seniority
Senior, hands-on IC with management responsibilities
