Senior Associate GCP Data Engineer
Core
Design, build, and maintain scalable data infrastructure and analytics solutions on Google Cloud Platform, including end-to-end development of Data Engineering use cases and the Equinix Data Lake platform.
Role type
Senior GCP Data Engineer
Builds
Scalable ETL/ELT pipelines, real-time streaming data pipelines, data lake and data warehouse solutions, and optimized BigQuery datasets.
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models
Required skills
Python, Java, SQL, Apache Beam, Apache Airflow, Terraform, Cloud Dataflow, Cloud Composer, dbt, Cloud Functions, Cloud Pub/Sub, Kafka, Spark, BigQuery, Cloud Storage, Cloud SQL, Dataproc, Cloud Monitoring, Cloud Logging, Git, CI/CD
Preferred skills
Google Cloud Professional Data Engineer certification, Docker, Kubernetes/GKE, data governance frameworks (GDPR, HIPAA, SOX), BI tools (Looker, Tableau, Power BI), advanced streaming technologies
Technologies
Google Cloud Platform (GCP), BigQuery, Cloud Dataflow, Cloud Composer, Dataform, dbt, Cloud Functions, Cloud Pub/Sub, Kafka, Dataproc, Cloud Storage, Cloud SQL, Dataplex, Analytics Hub, Terraform, Cloud Deployment Manager, Apache Beam, Apache Airflow, Spark, Beam, PostgreSQL, MySQL, Bigtable, Firestore, Docker, Kubernetes, GKE, Looker, Tableau, Power BI
Responsibilities
Design and develop scalable ETL/ELT pipelines; Build real-time streaming data pipelines; Implement automated data quality checks and monitoring; Optimize pipeline performance and cost efficiency; Architect and implement data lake and data warehouse solutions; Design optimal data models and partitioning strategies; Manage data lifecycle policies; Ensure data security and access control; Build and optimize BigQuery datasets; Create dimensional models and fact tables; Implement data marts and aggregation layers; Support self-service analytics through data cataloging; Integrate data from various sources; Implement change data capture (CDC) solutions; Troubleshoot data pipeline issues; Maintain data lineage documentation.
Seniority
Senior, hands-on IC
