Data Engineer - Databricks (Remote)
Core
Develop robust, scalable, and secure data pipelines and architectures to migrate structured, semi-structured, and unstructured data into a modern Lakehouse infrastructure using Fabric and Databricks.
Role type
Data Engineer (Lakehouse & Data Integration)
Builds
Data pipelines, data integration processes, and Lakehouse solutions for Retail Analytics and Smart Task products.
Domain
Retail technology and Trade Marketing
Deliverable
production ML models | product features | infrastructure
Required skills
Advanced SQL/T-SQL, relational and non-relational database modeling, Microsoft Fabric (Pipelines/ADF, Lakehouse, OneLake), Databricks (Jobs, Lakeflow, Asset Bundles, IaC), Git version control, data quality assurance, process documentation.
Preferred skills
Infrastructure as Code (Terraform), dimensional modeling (Star schema, SCD, CDC), Linux command line, Unity Catalog, Delta Sharing, Agile methodologies.
Technologies
Microsoft Fabric, Databricks, MSSQL, Postgres, MongoDB, Terraform, Git, Linux
Responsibilities
Align business requirements with project sponsors, map data sources, model data structures for analytics products, develop data integration processes, monitor and improve data quality and integration efficiency, document procedures, and propose solutions for engineering process evolution.
Seniority
Mid-level to Senior, hands-on IC
