Databricks Expert
Core
Design and implement data pipelines, manage data storage and lifecycle, and integrate Databricks with cloud platforms and analytics tools.
Role type
Data Engineer (Databricks)
Builds
Data pipelines and integrated data workflows
Domain
Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
Databricks, Python, Scala, data engineering concepts, cloud platforms (AWS, Azure, Google Cloud), data integration services (Azure Data Factory, AWS Glue, Google DataPrep)
Preferred skills
Databricks certification
Technologies
Databricks, Azure, AWS, Tableau, Azure Data Factory, AWS Glue, Google DataPrep
Responsibilities
Design and implement data pipelines using Databricks; Integrate Databricks with other tools and services; Manage data storage and lifecycle across Databricks workspaces; Diagnose and resolve issues within Databricks environments and workflows; Maintain clear documentation of data pipelines, processes, and workflows
Seniority
Mid-level to Senior