Databricks Data Engineer
Core
Design, develop, and implement complex, scalable Lakehouse solutions on the Databricks platform across major cloud environments (Azure, AWS, or GCP) to ensure data efficiency, reliability, and quality.
Role type
Senior Databricks Data Engineer
Builds
Modular data pipelines, data governance layers, and modern data warehousing solutions on Databricks Lakehouse architecture.
Domain
Cloud Data Engineering / Databricks Ecosystem
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, Databricks Lakehouse architecture, Unity Catalog, Delta Lake, Databricks SQL Warehouses, Declarative Automation Bundles (DABs), CI/CD pipelines (GitHub Actions, GitLab CI/CD), API integration, Git/Databricks Repos, dbt (bonus), Apache Spark, Databricks AI/ML and GenAI capabilities.
Preferred skills
Experience with Databricks Assistant/Genie, MLflow, Feature Store, Model Serving.
Technologies
Databricks, Delta Lake, Unity Catalog, Azure, AWS, GCP, GitHub Actions, GitLab CI/CD, dbt, Apache Spark, Mosaic AI.
Responsibilities
Design and build modular data pipelines using Delta Lake; implement data governance and secure data access layers; write clean, efficient SQL and Python code; establish and optimize CI/CD pipelines using DABs; automate data pipeline processes using Databricks Workflows or Spark Declarative Pipelines; integrate with cloud-native storage and security services; manage technical aspects of deliveries and liaise with business stakeholders.
Seniority
Senior, hands-on IC