Data Engineer
Core
Building and maintaining resilient on-premises data pipelines and systems to support Media Mix Optimization (MMO) models and analytics.
Role type
Senior Data Engineer (Big Data & Distributed Systems)
Builds
Scalable data ingestion, transformation, and storage workflows for MMO platforms
Domain
Marketing Analytics / Big Data Infrastructure
Deliverable
production ML models
Required skills
Distributed data processing, ETL/ELT design, Database management, Data pipeline orchestration, Performance tuning, Data governance
Preferred skills
Media Mix Modeling (MMM/MMO), Workflow scheduling, CI/CD automation, Data cataloging
Technologies
Apache NiFi, HDFS, PySpark, Hive, Postgres, Python, SQL
Responsibilities
Design and optimize scalable data pipelines for ingestion and cleansing; Architect and manage datasets on HDFS for high-volume storage; Develop distributed processing workflows in PySpark and Hive; Maintain and tune Postgres databases for high availability; Implement monitoring and alerting frameworks for pipeline health; Enforce data quality, lineage, and security standards.
Seniority
Senior, hands-on IC
