Lead Data Engineer - GCP
Core
Design, develop, and maintain scalable data engineering solutions and pipelines on Google Cloud Platform.
Role type
Senior GCP Data Engineer
Builds
Scalable ETL/ELT pipelines, data processing and transformation solutions
Domain
Cloud Data Engineering (GCP)
Required skills
Python, SQL, GCP services (BigQuery, GCS, Cloud Composer/Airflow, Dataflow, Pub/Sub, Dataproc), ETL/ELT pipeline development, data modeling, performance optimization, Git, CI/CD
Preferred skills
Apache Spark/PySpark, Terraform, GCP Dataform, real-time/streaming data pipelines, cloud security and IAM
Technologies
Google Cloud Platform, Python, SQL, BigQuery, Cloud Storage, Cloud Composer, Airflow, Dataflow, Pub/Sub, Dataproc, Apache Spark, PySpark, Terraform, GCP Dataform
