Senior Data Engineer
Core
Build, test, and maintain batch and streaming pipelines into QiCore, migrating Rewards data into the warehouse and single customer view.
Role type
Senior Data Engineer
Builds
Batch and streaming data pipelines, data warehouse models, and single customer views
Domain
Financial services / Data Engineering
Deliverable
production ML models
Required skills
SQL, Python, ETL/ELT pipeline development, GCP (BigQuery, Pub/Sub, Dataproc, Cloud Storage), data governance, data quality monitoring, orchestration, version control
Preferred skills
Experience with modern cloud warehouses or big data platforms, experience supporting acquisitions and platform migrations
Technologies
GCP, BigQuery, Pub/Sub, Dataproc, Cloud Storage
Responsibilities
Build, test, and maintain batch and streaming pipelines; Migrate Rewards data into the warehouse and single customer view; Model data for analytics and reporting; Monitor pipeline health and data quality; Support future acquisitions and platform migrations
Seniority
Senior, hands-on IC
