Analyst/Consultant - Data Engineer - Azure (INDM)
Core
Design and implement data pipelines using Azure Data Factory and Databricks to extract, transform, and load data into Bronze, Silver, and Gold layers for Business Intelligence teams.
Role type
Mid-level Data Engineer (Azure)
Builds
Data pipelines, data warehouses, and data lakes
Domain
Cloud Data Engineering (Azure)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, PySpark, Azure Data Factory, Azure Databricks, SQL, NoSQL (MongoDB, Cassandra), Data Governance
Preferred skills
Data modeling, pipeline optimization, multi-project management
Technologies
Azure Data Factory, Azure Databricks, Azure Blob Storage, MongoDB, Cassandra
Responsibilities
Design and implement data pipelines to deliver data to the BI team; Integrate data from diverse sources including databases and APIs; Manage and optimize relational and NoSQL databases; Implement and enforce data governance policies and security compliance.
Seniority
Mid-level, hands-on IC
