Senior Data Engineer - (GCP & Lakehouse Architecture) - On Site - Octopus by RTG
Core
Design, develop, and scale a cloud-native Data Lakehouse platform on GCP to empower analytics, machine learning, and business intelligence.
Role type
Senior IC data engineer (GCP & Lakehouse)
Builds
Scalable GCP-based Lakehouse ecosystem, high-throughput ETL/ELT pipelines, and enterprise-grade data models
Domain
Cloud data infrastructure, Big Data processing, Data Warehousing
Required skills
Apache Iceberg, Apache Airflow, Apache Spark, dbt, Python, SQL, Google Cloud Platform (BigQuery, Dataflow/Dataproc), Dimensional modeling, Data governance
Preferred skills
CI/CD for data pipelines, Data quality best practices
Technologies
GCP, Apache Iceberg, Apache Airflow, Apache Spark, dbt, BigQuery
Responsibilities
Design and maintain scalable GCP-based Lakehouse ecosystem; Architect and optimize high-throughput ETL/ELT pipelines; Implement large-scale distributed data processing; Leverage BigQuery for analytical queries and cost optimization; Write modular transformation code with automated testing; Lead dimensional and semantic data modeling; Optimize complex SQL queries; Partner with data scientists and product managers
Seniority
Senior, hands-on IC
