GCP Data Engineer
Core
Design, develop, and optimize data pipelines on Google Cloud Platform to provide reliable, secure, and performant data for Data Analysts, Data Scientists, and business teams.
Role type
GCP Data Engineer
Builds
Data pipelines and distributed data processing workflows on GCP
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models | product features
Required skills
SQL, Python, PySpark/Spark, GCP BigQuery, GCP Dataflow, GCP Dataproc, GCP Pub/Sub, GCP Cloud Storage, GCP Composer, Data Lake/Warehouse architecture, data quality controls, IAM, data governance, cost optimization
Preferred skills
Experience with modern BI tools, knowledge of .Net/Java/Node.js, familiarity with ERP/CRM systems
Technologies
Google Cloud Platform, BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, PySpark, Spark, Airflow
Responsibilities
Design, develop, and maintain data pipelines on GCP; Integrate and transform data from diverse sources (SQL/NoSQL, API, ERP, CRM, flat files); Develop distributed and optimized processing with PySpark/Spark on Dataproc; Orchestrate and automate workflows with Cloud Composer; Implement data quality, consistency, and security controls; Optimize processing performance and infrastructure costs; Document pipelines and ensure traceability; Collaborate with Data and IT teams to deliver ready-to-use datasets; Participate in GCP and cloud data solutions technology scouting
Seniority
Mid-Senior, hands-on IC
