Solution Architect, Delivery (Databricks)
Core
Lead end-to-end architecture for enterprise-scale data platforms and Lakehouse solutions using the Databricks Data Intelligence Platform, translating business objectives into scalable technical solutions.
Role type
Senior Solution Architect (Data & AI)
Builds
Enterprise Lakehouse solutions, data migrations, and AI/ML pipelines
Domain
Data Engineering & Cloud Architecture
Deliverable
production ML models
Required skills
Databricks Data Intelligence Platform, Apache Spark, Python, PySpark, SQL, Unity Catalog, Delta Lake, Infrastructure as Code (Terraform), CI/CD, Cloud Architecture (AWS/Azure/GCP), Data Governance, Security Frameworks
Preferred skills
MLflow, Feature Store, Model Serving, Vector Search, RAG, dbt, Power BI, Tableau, HIPAA/HITRUST/SOC 2 compliance
Technologies
Databricks, Delta Lake, Unity Catalog, Apache Spark, Python, PySpark, SQL, Terraform, GitHub Actions, GitLab, Azure DevOps, AWS, Azure, GCP, S3, ADLS Gen2, GCS, MLflow, Feature Store, Vector Search
Responsibilities
Design scalable Lakehouse solutions using Medallion Architecture; Implement enterprise-wide governance and security frameworks; Lead migration strategies from legacy warehouses to Databricks; Establish patterns for batch and real-time data processing; Guide engineering teams and conduct architectural reviews; Optimize Spark and Delta Lake performance; Establish FinOps practices and cost governance; Integrate ML/AI capabilities into data platforms; Advise senior client stakeholders on technical strategy.
Seniority
Senior, hands-on IC with leadership