Databricks Data Engineer
Core
Design and implement robust ETL/ELT workflows, optimize Lakehouse architectures, and enable advanced analytics and AI use cases on the Databricks platform for clients.
Role type
Senior Databricks Data Engineer (Consulting)
Builds
Scalable data pipelines, modern data ecosystems, and data-driven decision-making solutions
Domain
Data Engineering, Cloud Data Platforms, AI/ML Infrastructure
Deliverable
production ML models | product features
Required skills
Databricks platform expertise, Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow, ETL/ELT tools (DBT, Matillion, Talend), SQL, Python, cloud platforms (AWS, Azure, GCP), data modeling methodologies, CI/CD pipelines, data governance
Preferred skills
Databricks certifications, AI/ML workload experience, team leadership and mentoring
Technologies
Databricks, Spark, PySpark, Scala, Delta Lake, Unity Catalog, MLflow, DBT, Matillion, Talend, AWS, Azure, GCP, GitHub, Bitbucket
Responsibilities
Design and implement robust ETL/ELT workflows; integrate real-time and batch data sources; optimize Lakehouse architectures; collaborate with Solution Architects, Data Engineers, ML Engineers, and Client stakeholders; lead or mentor teams of engineers; ensure quality, governance, and security of data products
Seniority
Senior, hands-on IC with leadership/mentoring responsibilities
