Senior Databricks Data Engineer
Core
Design, develop, and implement scalable Lakehouse solutions on the Databricks platform, building modular data pipelines and governance layers.
Role type
Senior Databricks Data Engineer
Builds
Scalable Lakehouse solutions, modular data pipelines, and secure data access layers on Databricks.
Domain
Data Engineering / Cloud Data Platforms
Deliverable
production ML models
Required skills
SQL, Python, Databricks (Delta Lake, Unity Catalog), CI/CD (GitHub Actions, GitLab CI/CD), Declarative Automation Bundles (DABs), Cloud storage/security (AWS S3, Azure ADLS, GCS), API integration, AI coding tools (Copilot, Cursor, Databricks Assistant)
Preferred skills
dbt (dbt-databricks), Databricks AI/ML and GenAI capabilities (Mosaic AI, MLflow, Feature Store), Apache Spark
Technologies
Databricks, Delta Lake, Unity Catalog, GitHub Actions, GitLab CI/CD, AWS, Azure, GCP, Python, SQL, dbt, Apache Spark
Responsibilities
Design and implement complex Lakehouse solutions; build and optimize modular data pipelines; implement data governance and secure access; write efficient SQL and Python code; develop automation scripts using Databricks CLI/REST APIs; establish and optimize CI/CD pipelines; automate data pipeline processes; manage technical aspects of deliveries; liaise with business stakeholders.
Seniority
Senior, hands-on IC