Data Engineer (Azure)
Core
Design, develop, and maintain data pipelines for processing and analyzing large volumes of information in a cloud environment.
Role type
Data Engineer
Builds
Data pipelines for processing and analysis
Domain
Cloud data engineering
Deliverable
production ML models | infrastructure
Required skills
Python, PySpark, Azure Databricks, SQL, ETL/ELT pipelines, batch and streaming process optimization
Preferred skills
Delta Lake, Azure Data Factory, orchestration (Airflow), cloud data architecture, CI/CD
Technologies
Azure, Python, PySpark, Azure Databricks, SQL, Delta Lake, Azure Data Factory, Airflow
Responsibilities
Develop data pipelines in Python, process data with PySpark, develop and optimize processes in Azure Databricks, ingest, transform, and model data, integrate data from various sources, optimize performance of batch and streaming processes, work with data and business teams to define requirements
Seniority
Mid-level (3–5 years experience)
