Senior Data Platform Engineer (Azure, Databricks, Terraform)
Core
Building and evolving a self-service platform that automatically provisions secure, compliant Databricks environments for banking clients, connecting on-premises data with the cloud.
Role type
Senior Data Platform Engineer (Infrastructure & Orchestration)
Builds
Automated Databricks workspace provisioning, Azure infrastructure, and data synchronization pipelines
Domain
Financial Services / Cloud Infrastructure (Azure, Databricks)
Deliverable
production ML models | infrastructure
Required skills
Databricks workspace administration, Terraform (Azure), Apache Airflow, Kubernetes (OpenShift), data engineering fundamentals
Preferred skills
Docker containerization, GenAI on Databricks (agents, RAG), regulated industry experience
Technologies
Azure, Databricks, Terraform, Apache Airflow, Kubernetes, OpenShift
Responsibilities
Write Terraform code for deploying and managing Azure infrastructure; Develop orchestration and provisioning logic in Apache Airflow; Build data synchronization pipelines between on-premises data lakes and the cloud platform; Work on the governance layer to keep Databricks governance in sync with on-premises data governance
Seniority
Senior, hands-on IC