Data Engineer
Core
Designing and developing scalable data pipelines and ETL solutions to enable data-driven insights.
Role type
Data Engineer
Builds
Scalable data pipelines, ETL solutions, and data-driven insights
Domain
Cloud data engineering (Azure ecosystem)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Azure Databricks, Azure Data Factory, PySpark, SQL, Python, Azure Data Lake Storage (ADLS), Azure Synapse, Azure SQL DB, CI/CD
Responsibilities
Design and develop ETL pipelines using ADF for data ingestion and transformation; Collaborate with Azure stack modules like Data Lakes and SQL DW to build robust data solutions; Write SQL, Python, and PySpark code for efficient data processing and transformation; Implement DevOps and CI/CD deployments for data solutions.
Sourced via adzuna · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.