Lead Databricks Architect – Financial Services & Banking
Core
Design and implement an enterprise-grade Databricks Lakehouse architecture for banking applications including regulatory reporting, risk management, fraud detection, and real-time transaction processing.
Role type
Lead Databricks Architect (Financial Services)
Builds
Enterprise lakehouse platform, secure data pipelines, and migration from legacy data warehouses
Domain
Financial Services / Banking
Deliverable
production ML models
Required skills
Databricks architecture, Delta Lake, PySpark, Unity Catalog, Structured Streaming, Azure cloud services, Terraform, CI/CD pipelines, financial data modeling, regulatory compliance (GDPR, SOX, PCI-DSS)
Preferred skills
Databricks Certified Data Engineer Professional, Cloud Solutions Architect Certification (AWS/Azure)
Technologies
Databricks, Delta Lake, Unity Catalog, PySpark, Azure Data Lake Storage, Azure Data Factory, Terraform, GitHub Actions, Azure DevOps, Jenkins, Great Expectations
Responsibilities
Design enterprise-grade Databricks Lakehouse architecture, establish architectural patterns for batch and real-time streaming data pipelines, drive migration from legacy data warehouses, implement data security and governance frameworks, define best practices for PySpark and Delta Live Tables, establish CI/CD and MLOps automation frameworks, partner with Data Science and Quantitative Analytics teams, provide technical leadership and mentorship to data engineering teams
Seniority
Senior, hands-on IC with strategic leadership