Senior Data Engineer - Azure Databricks Platform
Core
Design, build, and operate the Azure Databricks data platform, managing medallion data models, pipelines, and infrastructure for global energy and industrial clients.
Role type
Senior IC data engineer (Azure Databricks platform)
Builds
Production data pipelines, medallion data models (bronze/silver/gold), and optimized Delta tables
Domain
Energy & Industrial Services / Cloud Data Engineering
Deliverable
production ML models
Required skills
Azure Databricks, Delta tables, medallion architecture, data quality frameworks, Terraform, Azure DevOps, RBAC, PII protection, CI/CD pipelines
Preferred skills
Databricks Certified Data Engineer Professional, Microsoft AZ-400, multi-environment Azure networking, regulatory frameworks (GDPR), global delivery model experience
Technologies
Azure Databricks, Terraform, Azure DevOps, Delta Lake, Entra ID
Responsibilities
Design and implement data quality frameworks with quarantine and error handling; Define job-specific compute configurations balancing performance and cost; Contribute to and troubleshoot Terraform-managed infrastructure; Own and maintain Azure DevOps build and release pipelines; Operate autonomously across workstreams from scoping to production deployment
Seniority
Senior, hands-on IC