Azure Data Engineer
Core
Design and build a fully automated Azure data platform on Databricks to enable a client's data team to construct real data products.
Role type
Senior Azure Data Engineer (Platform & Architecture)
Builds
Automated Azure data platform, CI/CD pipelines, and ETL integrations for a client's data products
Domain
Cloud Data Engineering (Azure, Databricks)
Deliverable
production ML models | product features | infrastructure
Required skills
Azure data engineering, Databricks, ETL pipeline construction, CI/CD for data, Infrastructure-as-Code (Terraform), Azure landing zone design, Virtual WAN, Kubernetes, VM management
Preferred skills
Assessment of existing data landscapes, pragmatic migration vs. replacement strategy, long-term client partnership
Technologies
Azure Synapse, Databricks, Terraform, Azure Virtual WAN, Kubernetes, Azure VMs
Responsibilities
Assess current Azure Synapse/Databricks setup and define migration/replacement strategy; Design and build automated Databricks-based Azure data platform; Build CI/CD pipelines for data ingestion, orchestration, and transformation; Develop ETL to connect data sources into an integration platform; Collaborate with client data team to enable data product development; Continuously improve platform reliability and automation
Seniority
Senior, hands-on IC
