IN_Senior Associate_Azure Data Engineering _D&A_Advisory_Noida
Core
Design, develop, and optimize scalable data pipelines and enterprise data warehousing solutions on the Azure cloud platform to transform complex data into actionable insights.
Role type
Senior Azure Cloud Data Engineer
Builds
Scalable ETL workflows, data pipelines, and data warehousing solutions for clients
Domain
Cloud Data Engineering (Azure)
Deliverable
production ML models | product features
Required skills
Python, SQL, Azure Databricks, Azure Data Factory, Apache Spark, Data modeling, Data warehousing, Git, ETL pipeline development
Preferred skills
OLTP/OLAP environments, Kafka, Hadoop, Azure Synapse Analytics, Azure DevOps, Agile methodologies
Technologies
Azure Databricks, Azure Data Factory, Azure Blob Storage, Azure Data Lake Storage, Azure Synapse Analytics, Apache Spark, Git, Kafka, Hadoop
Responsibilities
Design and manage scalable data pipelines using Azure Databricks and Data Factory; Write efficient Python code for cloud automation; Architect cloud-based data solutions integrating structured and unstructured data; Build and optimize ETL workflows; Develop data models for OLTP and OLAP systems; Manage Azure storage solutions; Troubleshoot performance bottlenecks; Lead code reviews and version control practices.
Seniority
Senior, hands-on IC