Principal Azure Data Engineer (Databricks)
Core
Architect and lead the delivery of enterprise-grade data solutions using the Databricks platform within the Azure ecosystem to modernize client data capabilities.
Role type
Principal Azure Data Engineer (Databricks)
Builds
Streaming and batch data pipelines, secure and scalable data lakehouse architectures
Domain
Financial Services / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Databricks platform (Unity Catalog, DeltaLake, Spark Structured Streaming), Python, PySpark, distributed data processing, CI/CD pipeline development, data lakehouse principles, data modelling, GDPR-compliant design
Preferred skills
Scala or Java development, client-facing and commercial skills, coaching and mentoring engineering teams, PII and sensitive data handling experience
Technologies
Databricks, Azure, DeltaLake, Spark Structured Streaming, Unity Catalog, Azure DevOps, Jenkins, GitHub Actions
Responsibilities
Lead end-to-end delivery of Databricks-based solutions across Azure environments, Architect secure and scalable pipelines, Develop and enforce engineering best practices across the data lifecycle, Engage with clients to define solution strategies and data governance frameworks, Mentor engineering teams and contribute to internal capability development initiatives
Seniority
Principal, strategy & mentorship
