Databricks Module Lead
Core
Building and managing data engineering solutions using Databricks for large-scale data processing and transformation.
Role type
Senior Databricks Data Engineer
Builds
ETL/ELT pipelines for batch and near real-time data workloads
Domain
Data Engineering / Cloud Data Platforms
Deliverable
production ML models | infrastructure
Required skills
PySpark, Advanced SQL, Python, Databricks, ETL/ELT pipeline development, Data pipeline monitoring and troubleshooting
Preferred skills
dbt, Apache Airflow, Azure DevOps, Git, CI/CD, Data warehousing concepts, Structured Streaming
Technologies
Databricks, PySpark, SQL, Python, dbt, Apache Airflow, Azure DevOps, Git
Responsibilities
Develop and optimize ETL/ELT pipelines; Troubleshoot, monitor, and support production data pipelines; Build and manage data engineering solutions on Databricks
Seniority
Mid-Senior, hands-on IC