Senior Data Engineer
Core
Build and run data pipelines for QiCore, a new data warehouse, integrating acquired businesses and ensuring reliable, governed data for business operations.
Role type
Senior Data Engineer
Builds
Batch and streaming data pipelines into a cloud data warehouse
Domain
Affiliate marketing, data warehousing, cloud infrastructure
Deliverable
production ML models
Required skills
SQL, Python, ETL/ELT pipeline development, GCP (BigQuery, Pub/Sub, Dataproc, Cloud Storage), data governance, data quality monitoring, orchestration, version control
Preferred skills
Experience with data migrations, single customer view implementation, platform scalability
Technologies
GCP, BigQuery, Pub/Sub, Dataproc, Cloud Storage, SQL, Python
Responsibilities
Build, test, and maintain batch and streaming pipelines; Migrate acquired business data into the warehouse; Model data for analytics and reporting; Monitor pipeline health and fix data quality issues at the root; Support future acquisitions and platform migrations
Seniority
Senior, hands-on IC
