Senior Product Data Engineer
Core
Building production pipelines that transform raw social media data (200M+ profiles) into accurate datapoints for brands to find and work with creators on Instagram, TikTok, and YouTube.
Role type
Senior Product Data Engineer
Builds
Creator collaboration, contact, and location data delivered via API
Domain
Social media data analytics and creator economy
Deliverable
production ML models
Required skills
PySpark, LLMs for data enrichment, data quality measurement, pipeline architecture, code review, performance profiling
Preferred skills
Experience with large-scale data processing, API design
Technologies
PySpark, LLMs
Responsibilities
Design and build end-to-end data pipelines for specific datapoints, implement automated quality checks and regression testing, optimize pipeline performance on large datasets, debug and fix production pipeline failures, review teammate code and collaborate on technical decisions
