AWS Databricks Architect -Sr Staff
Core
Architect end-to-end data solutions using Delta Lake, Unity Catalog, and Mosaic AI to support advanced AI/ML workloads and serve as a liaison between business stakeholders and engineering teams.
Role type
Sr Staff Databricks Architect (Data Engineering)
Builds
Enterprise data lakehouse platforms, data ingestion pipelines, and analytics solutions.
Domain
Data Engineering / Cloud Data Platforms
Deliverable
production ML models
Required skills
Delta Lake, Unity Catalog, Medallion Architecture, Python, PySpark, SQL, CI/CD integration, MLflow, Terraform, Azure DevOps, GenAI
Preferred skills
Machine learning, predictive analytics, legacy DW migration
Technologies
Databricks, Delta Lake, Unity Catalog, Mosaic AI, MLflow, Terraform, Azure DevOps, GitHub
Responsibilities
Architect end-to-end data solutions using Medallion Architecture; Implement and manage Unity Catalog for data governance; Lead and mentor cross-functional data engineering teams; Drive cost-efficiency by tuning Spark jobs and managing cluster policies; Integrate Databricks workflows into CI/CD pipelines; Provide architectural guidance for integrating machine learning models.
Seniority
Sr Staff, hands-on IC with strategic leadership
