Databricks & GCP Data Platform Architect
Core
Design and personally implement scalable Lakehouse solutions on Google Cloud Platform (GCP), including building pipelines, configuring Databricks, and troubleshooting production issues.
Role type
Senior IC Databricks & GCP Data Platform Architect
Builds
End-to-end Databricks Lakehouse architectures, batch and streaming pipelines, reusable frameworks, and production-ready data layers.
Domain
Cloud Data Engineering / Lakehouse Architecture
Deliverable
production ML models | product features | infrastructure
Required skills
Databricks (Apache Spark), GCP (GCS, BigQuery, Pub/Sub, IAM, VPC), Delta Lake, batch and streaming pipeline development, performance tuning, cost optimization, Unity Catalog, Terraform, CI/CD, Git, troubleshooting
Preferred skills
Delta Live Tables, MLflow, Vertex AI, multi-cloud Databricks experience (Azure/AWS)
Technologies
Databricks, Apache Spark, Google Cloud Platform, GCS, BigQuery, Pub/Sub, Unity Catalog, Terraform, Git, MLflow, Vertex AI
Responsibilities
Design end-to-end Databricks Lakehouse architecture on GCP; Build and optimize Spark jobs and Databricks notebooks; Implement ingestion pipelines from databases, enterprise applications, and streaming sources; Configure access control integrated with GCP IAM and set up secure networking; Build CI/CD pipelines for Databricks notebooks, jobs, and configs using Infrastructure as Code; Guide and mentor data engineers through code-level support and conduct architecture and code reviews.
Seniority
Senior, hands-on IC
