Data Engineer / Databricks
Core
Build, enhance, and maintain data pipelines in Databricks notebooks using Python and SQL to transform and clean data across bronze/silver/gold layers.
Role type
Data Engineer (Databricks)
Builds
Data pipelines and automated workflows for structured and semi-structured data.
Domain
Data Engineering / Cloud Data Platforms
Deliverable
production ML models | product features
Required skills
Python (pandas, PySpark), SQL, Databricks (notebooks, clusters, jobs, Delta tables), dbt (Jinja templating), Git, cloud environments (Azure/AWS/GCP)
Preferred skills
Unity Catalog, Delta Live Tables, orchestration tools (ADF, Airflow), VS Code, GitHub Copilot
Technologies
Databricks, Delta Lake, dbt, Python, SQL, Git, VS Code, GitHub Copilot
Responsibilities
Build and maintain data pipelines in Databricks notebooks; Develop and automate Databricks Jobs/Workflows; Transform and clean data using dbt; Monitor and improve job reliability and cost efficiency; Collaborate with analysts and data scientists; Follow version control best practices using Git and Databricks Repos
Seniority
Mid-level (2–4 years experience)