Senior Data Architect - Databricks Platform
Core
Architect responsible for designing and hardening enterprise-scale Databricks data platforms within client engagements, establishing guardrails, automation, and standards for safe platform usage.
Role type
Senior IC Data Architect (Databricks Platform)
Builds
Enterprise-scale Databricks data platforms, certified data products, semantic layers, and lineage/metadata exposure
Domain
Cloud data engineering, Databricks, AWS
Deliverable
production ML models | product features | infrastructure
Required skills
Databricks platform architecture, Unity Catalog, PySpark, Structured Streaming, AWS cloud-native architecture, Terraform (IaC), FinOps, stakeholder communication, technical documentation
Preferred skills
Data migration strategy, OLTP/OLAP system design, cluster optimization, CI/CD implementation
Technologies
Databricks, AWS, PySpark, Terraform, Unity Catalog, Delta Lake
Responsibilities
Lead architectural design for Databricks-based data platforms or modernization programs; Design high-volume batch and real-time streaming pipelines; Design and implement automation (ConfigOps), CI/CD, and guardrail patterns; Build and maintain certified data products and semantic layers; Ensure technical viability, scalability, and production readiness of platform components; Communicate architectural decisions and trade-offs to technical and business stakeholders; Partner with client business and engineering teams to translate use-case needs into platform capabilities
Seniority
Senior, hands-on IC
