Data Engineer GCP (Pub/Sub, DBT)
Core
Developing and maintaining data transformation pipelines, processing large volumes of data, and managing data flows for retail clients.
Role type
Senior Data Engineer (GCP)
Builds
Data transformation pipelines, data flows, and generic user interfaces
Domain
Retail / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
DBT, Advanced SQL, BigQuery, GCP Pub/Sub, GitLab CI/CD, Docker Compose, PostgreSQL, Linux, Shell Bash, Git
Preferred skills
Vim, Agile Scrum, Internal framework (Génépi)
Responsibilities
Develop and maintain data transformation pipelines with DBT; Manipulate and process large volumes of data via BigQuery and advanced SQL; Manage data flows and integrate with Pub/Sub; Automate data workflows via GitLab CI/CD and Docker Compose; Develop batch processing for data feed and export; Deploy generic user interfaces via SQL inserts; Develop Shell Bash scripts in a Linux environment.
Seniority
Senior, hands-on IC
