Data Engineer Platform and Tools – Google Cloud Platform (GCP)
Core
Design, build, and maintain scalable data pipelines and data warehouse solutions on Google Cloud Platform (GCP) to ensure data quality, performance, and reliability.
Role type
Senior Data Engineer (GCP)
Builds
Batch and streaming data pipelines, ETL/ELT workflows, and data orchestration solutions for enterprise data needs.
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer), Python, SQL, Shell Scripting, ETL/ELT, Data Warehousing, Data Modeling, Git, Terraform, Docker, Kubernetes
Preferred skills
Oracle Cloud, OIC, ODT, Golden Gate, AIDP
Technologies
BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer, Cloud Logging, Cloud Monitoring, Cloud Build, Jenkins, Terraform, Docker, Kubernetes
Responsibilities
Design and develop batch and streaming data pipelines on GCP; Build and optimize ETL/ELT workflows using BigQuery, Dataflow, and Cloud Storage; Develop and maintain data orchestration workflows using Cloud Composer (Airflow); Optimize SQL queries and BigQuery performance; Monitor, troubleshoot, and support production data pipelines; Collaborate with cross-functional teams to deliver scalable data solutions.
Seniority
Senior, hands-on IC