Data Engineer (Databricks)
Core
Designing and implementing a cohesive relational and analytical data model by integrating data across multiple systems to serve as a single source of truth for downstream analytics.
Role type
Senior Data Engineer (Databricks/Azure)
Builds
Automated data pipelines, ETL/ELT processes, and a unified data foundation on Azure and Databricks.
Domain
Retail / Consumer Packaged Goods / Cloud Data Engineering
Deliverable
production ML models
Required skills
Python, PySpark, SQL, Data Modeling (Star/Snowflake), Azure Data Stack (ADLS, ADF, Synapse), Databricks, Code Review, CI/CD
Preferred skills
Technical guidance to junior peers, Vendor oversight, Architectural documentation
Technologies
Databricks, Azure, PySpark, Pandas, SQL
Responsibilities
Design, build, test, and deploy automated data pipelines and ETL/ELT processes; Write clean, maintainable, production-ready code in Python and PySpark; Develop, tune, and optimize complex SQL queries; Act as technical SME and quality gatekeeper for external vendor developers; Perform structured code reviews and PR approvals; Collaborate with Data Analysts and business stakeholders to translate requirements into robust data structures.
