Lead Data Engineer - GCP
Core
Design, develop, and maintain scalable data engineering solutions and pipelines on Google Cloud Platform.
Role type
Senior GCP Data Engineer
Builds
Scalable ETL/ELT pipelines, data processing solutions, and optimized data models for large-volume datasets.
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models | product features
Required skills
Python, SQL, GCP services (BigQuery, GCS, Cloud Composer/Airflow, Dataflow, Pub/Sub, Dataproc), ETL/ELT pipeline development, data modeling, performance optimization, Git, CI/CD
Preferred skills
Apache Spark/PySpark, Terraform, GCP Dataform, real-time/streaming data pipelines, cloud security and IAM
Technologies
Google Cloud Platform, BigQuery, Cloud Storage, Cloud Composer, Airflow, Dataflow, Pub/Sub, Dataproc, Apache Spark, PySpark, Terraform, GCP Dataform
Responsibilities
Design and develop scalable data pipelines; Develop data processing and transformation solutions; Build and optimize ETL/ELT pipelines; Perform data modeling, validation, and performance optimization; Monitor and troubleshoot data pipelines; Implement data quality, security, and governance best practices; Participate in code reviews and technical architecture discussions.
