GCP Data Engineer
Core
Design, build, and maintain scalable data pipelines and infrastructure on Google Cloud Platform to ensure data quality and availability.
Role type
Senior GCP Data Engineer
Builds
Production data pipelines, data warehouses, and streaming architectures
Domain
Cloud Data Engineering / Big Data
Required skills
Python, Advanced SQL, BigQuery, Dataflow/Apache Beam, Dataproc/PySpark, Pub/Sub, Cloud Composer/Airflow
Preferred skills
Dataform, dbt, CI/CD, BigQuery ML, Looker, Terraform
Technologies
Google Cloud Platform (GCP), BigQuery, Dataflow, Apache Beam, Dataproc, PySpark, Pub/Sub, Cloud Composer, Airflow, Dataform, dbt, Looker, Terraform
Responsibilities
Implement data quality checks, reconciliation, alerting, retries, and backfills; Monitor and troubleshoot production pipelines; Develop Airflow DAGs and streaming/batch frameworks; Optimize BigQuery datasets and queries for cost and performance.