Senior Data Engineer - GCP
Core
Design, build, and maintain scalable data pipelines and cloud-based data platforms on Google Cloud Platform to transform raw data into reliable systems for analytics and reporting.
Role type
Senior IC data engineer (GCP)
Builds
Scalable data pipelines, data lakes, and data warehouses on GCP
Domain
Cloud data engineering / Big Data
Deliverable
production ML models | product features
Required skills
Python, SQL, Spark, ETL/ELT pipeline development, data modeling, real-time streaming architectures, API integrations, CI/CD, Docker, Kubernetes, Terraform
Preferred skills
Google Cloud Professional Data Engineer certification
Technologies
BigQuery, Cloud Storage, Cloud Dataflow, Cloud Dataproc, Pub/Sub, Cloud Composer, Cloud Functions, Cloud Run, GitHub Actions, Jenkins, Docker, Kubernetes, Terraform
Responsibilities
Design and build scalable data pipelines on GCP; Develop and optimize batch and real-time data processing solutions; Build and manage data lakes and data warehouses; Develop and maintain datasets for analytics and reporting; Improve data quality, reliability, and efficiency; Create solution design and technical documentation; Implement DevOps and CI/CD practices for data pipelines
Seniority
Senior, hands-on IC