Databricks Platform Architect
Core
Lead the architectural design and hands-on migration of legacy relational database systems (SQL Server/T-SQL) to a modern, cloud-native Databricks Lakehouse platform for enterprise financial and tax allocation engines.
Role type
Senior IC Databricks Platform Architect / Migration Lead
Builds
Cloud-native data lakehouse, distributed processing frameworks, and production-ready reference patterns for complex financial calculations.
Domain
Financial services / Data Engineering / Cloud Native
Deliverable
production ML models | product features
Required skills
Databricks Lakehouse architecture, Delta Lake, Unity Catalog, Apache Spark / PySpark, SQL Server, T-SQL, Stored Procedures, Apache Airflow, Terraform, dbt, PyTest, FinOps, cluster tuning, autoscaling, data lineage, schema evolution, AI-assisted code generation, Git-based workflows
Preferred skills
Databricks Certified Data Engineer Associate / Professional, Databricks Certified Solutions Architect, AWS Certified Database Specialist
Technologies
Databricks, Delta Lake, Unity Catalog, Apache Spark, PySpark, SQL Server, T-SQL, Apache Airflow, Terraform, dbt, PyTest, Claude, LLMs
Responsibilities
Validate and own target architecture on Databricks; define migration strategies to convert stored procedures to PySpark/SDP; design distributed processing frameworks and control flows; implement performance acceleration techniques (caching, partition pruning) to meet sub-30-second SLAs; deploy enterprise-level pipeline orchestration and observability; implement data governance models and lineage; establish best practices for AI-assisted code generation; lead code walkthroughs and design reviews.
Seniority
Senior, hands-on IC
