GCP Engineer
Core
Design and build large-scale data ingestion, processing, and streaming pipelines on Google Cloud Platform for client business development and delivery engagements.
Role type
Senior Data Engineer (GCP)
Builds
Real-time and batch data processing pipelines, data ingestion frameworks, and ETL solutions on GCP.
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models | product features
Required skills
Python, SQL/PL SQL, GCP (Dataflow, BigQuery, Composer), Java, Real-time streaming concepts, Message queues (Kafka, RabbitMQ, PubSub), Caching systems (Redis), Data Warehouse/ETL design, Modular code development with design patterns.
Preferred skills
Terraform, DevOps pipelines, IAM/Authentication protocols, Google/OneDrive APIs, GCP Professional Data Engineer certification.
Technologies
GCP, Dataflow, Apache Beam, BigQuery, Composer, Python, Java, Kafka, RabbitMQ, PubSub, Redis, JIRA, Confluence, GIT.
Responsibilities
Engineer ingestion and processing pipelines on GCP; Handle data quality, governance, and reconciliation; Automate repeatable tasks into reusable frameworks; Build streaming/batching solutions; Contribute to agile ceremonies.
Seniority
Senior, hands-on IC