Data Architect - Databricks
Core
Lead strategic enterprise data modernization using Medallion architecture on AWS Databricks to enable advanced analytics, machine learning, and secure data access.
Role type
Senior Data Architect (Cloud Data Platform)
Builds
Scalable cloud-native data ecosystems, governed data models, and GenAI-ready data foundations.
Domain
Cloud Data Engineering & Architecture (AWS Databricks)
Deliverable
production ML models | infrastructure
Required skills
Enterprise data modernization leadership, Medallion architecture design, Data governance frameworks, CI/CD for data platforms, AI/ML and GenAI data pipeline design, Data Warehousing, Data Modeling (Dimensional, Data Vault), MDM, Data Quality, Metadata Management, Databricks (Delta Lake, Unity Catalog, DLT, MLflow), AWS ecosystem (S3, Glue, EMR, Lambda, Redshift, Lake Formation, Athena, DMS), Real-time/streaming technologies (Kafka, Kinesis), Orchestration tools (Apache Airflow, MWAA)
Preferred skills
AWS, Databricks, and/or Snowflake certifications
Technologies
Databricks, AWS, Snowflake, Kafka, Kinesis, Apache Airflow, MWAA, Delta Lake, Unity Catalog, MLflow, Atlan
Responsibilities
Lead enterprise-scale implementation of data warehouse platforms on Databricks and Snowflake; Design and implement Medallion architecture and scalable enterprise data models; Establish enterprise data governance frameworks including cataloging, lineage, and compliance using Atlan; Define and implement CI/CD pipelines for infrastructure and data platform deployments; Design data architectures supporting AI/ML and Generative AI workloads including vector storage and feature layers; Build scalable ingestion frameworks for batch, streaming, and CDC pipelines; Develop target-state architecture blueprints and enforce data standards across teams; Collaborate with engineering, analytics, and data science teams to ensure platform alignment; Engage with clients as a trusted advisor for data strategy and roadmap definition.
Seniority
Senior, hands-on IC with leadership responsibilities
