Senior Data Engineer - Azure Databricks & Spark
Core
Design and implement scalable ETL pipelines and data processing solutions using Azure Databricks and Apache Spark to support business analytics and operational insights.
Role type
Senior Data Engineer (Azure Databricks & Spark)
Builds
Scalable data ingestion and transformation workflows, data processing solutions, and Power BI dashboards.
Domain
Cloud data engineering, ETL, and data warehousing on Azure.
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Azure Databricks, Azure Data Factory, Apache Spark, ETL design, SQL, data warehousing, cloud architecture, data profiling, data cleansing, pipeline optimization, Power BI.
Preferred skills
None stated.
Technologies
Azure Cloud, Databricks, Power BI, SQL, Spark.
Responsibilities
Design and implement ETL pipelines utilizing Azure Data Factory; Construct scalable workflows for data ingestion and transformation; Develop data processing solutions employing Azure Databricks and Apache Spark; Conduct data profiling, cleansing, validation, and quality assurance checks; Enhance data pipelines for maximum performance, reliability, and scalability; Generate and maintain Power BI reports and dashboards for operational insights.
Seniority
Senior, hands-on IC