Senior Data Engineer (Databricks Migration)
Core
Migrate a large-scale analytical platform from BigQuery to Databricks and design scalable Lakehouse architectures using Delta Lake.
Role type
Senior Data Engineer (Databricks Migration)
Builds
Scalable Spark-based data processing solutions, medallion architecture layers, and modern data platforms.
Domain
Retail analytics and cloud data engineering
Deliverable
production ML models
Required skills
Python, SQL, PySpark, Databricks, Delta Lake, Apache Spark, Airflow, CI/CD, Unity Catalog
Preferred skills
GCP, AWS, Azure, retail analytics, machine learning, platform modernization
Technologies
Databricks, Apache Spark, PySpark, Delta Lake, Python, SQL, Airflow, GCP, CI/CD, Unity Catalog
Responsibilities
Migrate analytical platform from BigQuery to Databricks, design Lakehouse architectures, develop and optimize data pipelines, implement incremental processing strategies, build medallion architecture layers, implement data governance and security, collaborate with cross-functional teams, conduct code reviews, troubleshoot and optimize SQL and Spark workloads, support production deployments.
Seniority
Senior, hands-on IC