Media Data Engineer (Databricks)
Core
Design, develop, and implement robust data pipelines to process campaign data from social media platforms (TikTok, YouTube, Instagram) for media analytics and digital products.
Role type
Senior Data Engineer (Media Analytics)
Builds
Scalable data pipelines and analytics solutions for media digital products
Domain
Media Analytics / Social Media Data / Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
PySpark, Databricks, SQL, Google Cloud Platform (GCP), Data Modeling, Data Architecture, Workflow Orchestration
Preferred skills
Social Media Data Integration, Databricks Workflow Management, Airflow
Technologies
Databricks, PySpark, SQL, Google Cloud Platform (BigQuery, Cloud Storage, Dataflow, Pub/Sub), GitHub Copilot, Airflow
Responsibilities
Design and develop high-quality code in Databricks for media campaign data; Assemble and prepare large complex datasets from social media sources; Partner with data architects to ensure technical solutions align with blueprints; Provide L3 support for existing data processes; Identify and implement initiatives to reduce technical debt; Apply coding standards and best practices on GCP.
Seniority
Senior, hands-on IC
