Enterprise Architect - Databricks
Core
Architect enterprise Databricks Lakehouse platforms, data governance frameworks, and AI/ML solutions on major cloud providers.
Role type
Senior Enterprise Architect (Databricks Platform & AI)
Builds
Multi-region Databricks deployments, medallion architecture pipelines, LLM/RAG workloads, and MLOps frameworks.
Domain
Cloud Data Engineering & Generative AI
Deliverable
production ML models | product features | infrastructure
Required skills
Databricks Certified Data Engineer Professional, Apache Spark (PySpark/Scala), Delta Lake, Delta Live Tables, Unity Catalog, Cloud Infrastructure (Azure/AWS/GCP), Infrastructure-as-Code (Terraform), MLflow, SQL, Real-time Streaming
Preferred skills
Databricks Associate Developer for Apache Spark, Mosaic AI, Vector Search, Data Mesh patterns
Technologies
Databricks, Unity Catalog, Delta Live Tables, Azure AD, Okta, Kafka, Terraform, MLflow, Mosaic AI
Responsibilities
Design multi-workspace Databricks deployments with network isolation; Define medallion architecture standards and enforce data contracts; Lead migration of legacy data warehouses to the Databricks Lakehouse; Architect LLM/Generative AI workloads including RAG pipelines and fine-tuning; Implement Unity Catalog for fine-grained access control and lineage tracking; Mentor data architects and engineers; Author solution architecture documents and RFP responses.
Seniority
Senior, hands-on IC with mentorship responsibilities
