Data Engineer - GCP
Core
Designing, developing, deploying, and maintaining scalable data pipelines and ETL processes on Google Cloud Platform.
Role type
Junior to Mid-Level GCP Data Engineer
Builds
Scalable data pipelines and ETL processes for data-driven decision-making
Domain
Cloud data engineering (GCP)
Deliverable
production ML models
Required skills
GCP services (Cloud Composer, BigQuery, Pub/Sub), Python, dbt, CI/CD processes, Git repository management, SCD Type 2 processes, data orchestration and scheduling
Preferred skills
Python, Java, or Scala; Docker or Kubernetes
Technologies
Cloud Composer, BigQuery, Pub/Sub, Buildkite, Jira, Atlassian Confluence, Apache Airflow
Responsibilities
Design and maintain data pipelines and ETL processes; Support CI/CD pipelines; Manage Git repositories and link changes to Jira; Contribute to SCD Type 2 processes; Schedule and orchestrate workloads; Follow data governance and security best practices; Collaborate with analysts and data scientists; Document changes and present deployment updates
Seniority
Junior to Mid-Level, hands-on IC
