Azure Data Engineer (ID: 4098)
Core
Design, develop, and maintain scalable data pipelines and ETL/ELT processes using Microsoft Azure services to support analytics and reporting.
Role type
Senior IC Azure Data Engineer
Builds
Scalable data pipelines, data processing solutions, and data integration workflows
Domain
Cloud data engineering (Azure)
Deliverable
production ML models
Required skills
Python, Azure Data Factory, Azure Databricks, Apache Spark, API integration, data ingestion, ETL/ELT, pipeline monitoring, performance optimization
Preferred skills
Agile methodologies, technical documentation, cross-functional collaboration
Technologies
Microsoft Azure, Azure Data Factory, Azure Databricks, Apache Spark, Python
Responsibilities
Design and maintain scalable data pipelines; Develop data processing and transformation solutions; Build and manage data workflows; Integrate data from multiple sources using APIs; Monitor and troubleshoot pipeline failures; Optimize pipeline performance and reliability
Seniority
Mid-Senior, hands-on IC