Data Engineer (Databricks)
Core
Designing and implementing a cohesive relational and analytical data model by integrating data across multiple systems to serve as a single source of truth for downstream analytics.
Role type
Senior Data Engineer (Databricks/Azure)
Builds
Robust, scalable data pipelines and a unified data foundation on Azure and Databricks
Domain
Retail/Consumer Goods, Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
Python, PySpark, SQL, Data Modeling, Azure Data Stack, Databricks
Preferred skills
Code review expertise, Vendor oversight, CI/CD practices
Technologies
Azure, Databricks, PySpark, SQL, Azure Data Factory, Synapse Analytics
Responsibilities
Design, build, test, and deploy automated data pipelines and ETL/ELT processes; Develop, tune, and optimize complex SQL queries; Act as technical SME and quality gatekeeper for external vendor developers; Collaborate with stakeholders to translate analytical requirements into robust data structures
Seniority
Senior, hands-on IC