Senior Associate - GCP Data Engineer
Core
Design, build, and maintain scalable data infrastructure and analytics solutions on Google Cloud Platform, including end-to-end development of Data Engineering use cases and the Equinix Data Lake platform.
Role type
Senior GCP Data Engineer
Builds
Scalable ETL/ELT pipelines, real-time streaming data pipelines, data lake and data warehouse solutions, and optimized BigQuery datasets.
Domain
Cloud-native data engineering on Google Cloud Platform
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, Java, SQL, Apache Beam, Apache Airflow, Terraform, dimensional modeling, data lifecycle management, data security, CI/CD pipelines
Preferred skills
Google Cloud Professional Data Engineer certification, containerization (Docker, Kubernetes/GKE), data governance frameworks (GDPR, HIPAA, SOX), business intelligence tools (Looker, Tableau, Power BI), streaming technologies beyond GCP (Kafka, Spark Streaming)
Technologies
BigQuery, Cloud Dataflow, Cloud Composer, Dataform, dbt, Cloud Functions, Cloud Pub/Sub, Kafka, Dataproc, BigQuery, Cloud Storage, Cloud SQL, Dataplex, Analytics hub
Responsibilities
Design and develop scalable ETL/ELT pipelines; build real-time streaming data pipelines; implement automated data quality checks and monitoring; optimize pipeline performance and cost efficiency; architect and implement data lake and data warehouse solutions; design optimal data models and partitioning strategies; manage data lifecycle policies; ensure data security and access control; integrate data from various sources; implement change data capture solutions; troubleshoot data pipeline issues; maintain data lineage documentation.
Seniority
Senior, hands-on IC
