Data Engineer - (Azure)
Core
Building, optimizing, and maintaining scalable cloud data platforms and analytics-ready datasets using Microsoft Azure and Databricks.
Role type
Senior individual contributor data engineer (Azure & Databricks)
Builds
Scalable ETL/ELT pipelines, data lakes, and analytical data stores
Domain
Cloud data engineering (Azure ecosystem)
Deliverable
production ML models | product features
Required skills
Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage Gen2, SQL (complex queries, joins, aggregations), Python (ETL/ELT), PySpark, data modeling, partitioning, schema evolution, Infrastructure as Code (ARM/Terraform), CI/CD pipelines, logging and monitoring
Preferred skills
Azure Event Hubs, Kafka, Delta Lake, Power BI integration, data governance frameworks, cost optimization, Agile delivery
Technologies
Azure, Databricks, Synapse, ADLS, ADF, PySpark, Terraform, Azure DevOps, GitHub Actions, Power BI
Responsibilities
Build scalable ETL/ELT pipelines using Azure and Databricks; Develop SQL-based transformations and Python/PySpark pipelines; Ingest and process data using ADF, Databricks, and ADLS; Monitor data pipeline health, performance, and data quality; Troubleshoot pipeline failures and perform root-cause analysis; Work closely with architects and product teams to translate business needs into working Azure data solutions
Seniority
Senior, hands-on IC