Databricks Data Engineer
Core
Design and implement robust ETL/ELT workflows, build scalable data pipelines, and optimize Lakehouse architectures on the Databricks platform to enable advanced analytics and AI use cases for clients.
Role type
Senior Databricks Data Engineer (Consulting)
Builds
Scalable data pipelines, modern data ecosystems, and governed data products for client organizations
Domain
Cloud Data Engineering / Lakehouse Architecture
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Databricks platform expertise (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow), ETL/ELT tool proficiency (DBT, Matillion, Talend), SQL and Python, cloud platform experience (AWS, Azure, GCP), data modeling methodologies (star schemas, Data Vault, Kimball, Inmon), CI/CD pipelines, data governance and security frameworks
Preferred skills
AI/ML workload experience, team leadership and mentoring
Technologies
Databricks, Spark, PySpark, Scala, Delta Lake, Unity Catalog, MLflow, DBT, Matillion, Talend, AWS, Azure, GCP, GitHub, Bitbucket
Responsibilities
Develop batch and streaming data pipelines, architect Lakehouse solutions, collaborate with Solution Architects and Data Engineers, engage with client stakeholders up to Head of Data Engineering, ensure data quality and governance compliance
Seniority
Senior, hands-on IC with mentoring responsibilities
