Sr Databricks Engineer
Core
Design and implement scalable, enterprise-grade data platforms using Databricks Lakehouse Platform, focusing on end-to-end data architectures, ETL/ELT pipelines, and real-time streaming solutions.
Role type
Senior Databricks Solution Architect
Builds
Scalable data platforms, ETL/ELT pipelines, real-time streaming solutions, and advanced analytics platforms
Domain
Data Engineering / Cloud Platforms (AWS/Azure/GCP)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Databricks (clusters, notebooks, Delta Lake, MLflow, Unity Catalog), Spark, Python, SQL, distributed data processing, large-scale data solution architecture, streaming technologies (Structured Streaming, Kafka, Kinesis, EventHub), CI/CD for data pipelines
Preferred skills
Databricks Certified Data Engineer Professional / Architect, AWS/Azure/GCP cloud architect certifications, BI tools (Tableau, Power BI, Looker), machine learning workflows and MLOps, large-scale data modernization or cloud migration
Technologies
Databricks, Delta Lake, MLflow, Unity Catalog, Delta Live Tables, Spark, Python, SQL, Kafka, Kinesis, EventHub, Azure DevOps, GitHub Actions, Jenkins
Responsibilities
Design end-to-end data architectures using Databricks Lakehouse Platform; Architect scalable ETL/ELT pipelines and real-time streaming solutions; Lead technical discussions and design workshops with engineering teams and business stakeholders; Define and implement governance standards across Databricks workspaces; Evaluate integration of complementary technologies (Delta Live Tables, MLflow, Unity Catalog, streaming frameworks)
Seniority
Senior, hands-on IC with architectural leadership
