Senior Data Architect - Databricks Platform
Core
Design and harden enterprise-scale Databricks data platforms for client engagements, establishing guardrails, automation, and standards to enable safe self-service and agent-driven use cases.
Role type
Senior Data Architect (Databricks Platform)
Builds
Enterprise data platforms, certified data products, semantic layers, and CI/CD automation pipelines.
Domain
Cloud Data Engineering / Generative AI Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Databricks architecture, Unity Catalog, PySpark, Structured Streaming, AWS cloud-native architecture, Terraform (IaC), FinOps, data migration strategy, stakeholder communication
Preferred skills
Lakehouse patterns, Delta Lake optimization, agent-driven data use cases, multi-database migration
Technologies
Databricks, AWS, PySpark, Terraform, Unity Catalog, Delta Lake
Responsibilities
Lead architectural design for Databricks-based data platforms and modernization programs; Design high-volume batch and real-time streaming pipelines; Implement automation (ConfigOps), CI/CD, and governance guardrails; Partner with client business teams to translate use-case needs into platform capabilities; Ensure technical viability, scalability, and production readiness of platform components.
Seniority
Senior, hands-on IC with mentorship responsibilities
