Senior Cloud Data Engineer
Core
Technical lead for migrating 100TB+ of enterprise data from Cloudera Hadoop/AWS to Google Cloud Platform (GCP) and building a modern Data Fabric centered on BigQuery.
Role type
Senior Cloud Data Engineer (Data Migration & Platform Modernization)
Builds
Modern cloud-native data pipelines, scalable ingestion/transformation frameworks, and optimized BigQuery storage models.
Domain
Enterprise Data Engineering, Cloud Modernization, Data Fabric
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
Cloud data engineering, Cloudera (HDFS/Hive), Google Cloud Platform (GCP), BigQuery, Medallion Architecture, SQL, AWS data storage (S3/FSx), large-scale data migration, data optimization, troubleshooting
Preferred skills
Data Fabric implementation, serverless data architecture, data lake modernization, data governance, data quality frameworks, CI/CD for data engineering, Infrastructure as Code, Python/Spark development
Technologies
Cloudera, Hadoop, HDFS, Hive, Google Cloud Platform, BigQuery, AWS S3, AWS FSx, Python, Spark
Responsibilities
Lead migration of over 100TB of enterprise data from Cloudera Hadoop environments into Google Cloud Platform; Migrate data from HDFS, Hive, AWS S3, and FSx into BigQuery; Design and develop modern cloud-native data pipelines; Design and implement Medallion Architecture (Bronze, Silver, Gold); Optimize storage, performance, and scalability of data platforms.