Azure Data Engineer
Core
Design and implement scalable data pipelines and optimize ETL processes using Azure Databricks and PySpark.
Role type
Senior Azure Data Engineer
Builds
Scalable data pipelines and optimized ETL processes
Domain
Cloud data engineering (Azure ecosystem)
Deliverable
production ML models | product features
Required skills
Databricks, PySpark, Azure Data Factory, SQL, Python, Delta Lake, ETL frameworks, data warehousing, data lakes, Azure security (Key Vault, RBAC, Managed Identity)
Preferred skills
Experience integrating data from multiple sources (databases, APIs)
Technologies
Azure Databricks, PySpark, Azure Data Factory, Delta Lake
Responsibilities
Design and implement data pipelines, develop and manage ETL processes, optimize Spark jobs for performance, monitor and debug pipelines, ensure data quality and validation, integrate data from multiple sources, maintain documentation
Seniority
Senior, 5–8 years experience