Data Engineer (DATABRICKS / PYSPARK)
Core
Develop and maintain scalable data pipelines for processing large volumes of marketing and advertising data in batch and near real-time environments using modern Data Lakehouse architecture.
Role type
Middle Data Engineer (Databricks/PySpark)
Builds
Scalable Data Lakehouse solutions, ETL processes, and data workflows for an AdTech and analytics company.
Domain
Big Data, Cloud-Native, AdTech
Deliverable
production ML models
Required skills
SQL, Python, PySpark, Databricks, Delta Lake, Medallion Architecture, ETL development, Data pipeline optimization
Preferred skills
AWS S3
Technologies
Databricks, PySpark, SQL, Delta Lake, AWS S3, Python
Responsibilities
Develop and maintain data pipelines, transform and validate data, build and automate ETL processes, troubleshoot and monitor pipelines, improve data quality and organization.
Seniority
Middle, hands-on IC
