Databricks Specialist
Core
Design and optimize end-to-end data pipelines, lakehouse storage patterns, and MLOps workflows for large-scale data and generative AI solutions.
Role type
Senior Databricks Data Engineer / Solutions Architect
Builds
Production data pipelines, lakehouse storage, MLOps workflows, and generative AI/vector search solutions
Domain
Data Engineering, Cloud Data Platforms, MLOps, Generative AI
Deliverable
production ML models
Required skills
Apache Spark internals, Delta Lake, Python, SQL, Scala, Cloud platforms (AWS/Azure/GCP), MLOps, Unity Catalog, CI/CD
Preferred skills
Databricks Data Engineer or Solutions Architect certification
Technologies
AWS, Azure, GCP, Databricks, Spark, Delta Lake, MLflow, Unity Catalog, Python, SQL, Scala
Responsibilities
Design end-to-end data pipelines and ETL/ELT processes; Optimize cluster sizing and query execution; Implement MLOps workflows and deploy generative AI solutions; Manage security settings and workspace administration; Translate business needs into technical solutions with stakeholders.