Google Cloud Platform (GCP) Data Engineer
Core
Design, develop, and maintain robust data pipelines and ETL processes for large-scale data processing systems and data lakes/warehouses on Google Cloud Platform.
Role type
Senior GCP Data Engineer
Builds
Scalable batch and real-time streaming data pipelines, modernized cloud-native architectures, and automated CI/CD pipelines for US federal government clients.
Domain
US Federal Government / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, ETL/ELT concepts, GCP native services (BigQuery, Dataflow, Cloud Storage, Dataproc, Pub/Sub), data governance, data quality checks, CI/CD architecture
Preferred skills
Google Cloud Professional Data Engineer Certification, legacy database migration (Oracle, SQL Server to Cloud SQL, AlloyDB, Spanner), federal data strategies (RMF, IL4/IL5)
Technologies
Python, SQL, Apache Beam, BigQuery, Dataflow, Cloud Composer, Cloud Storage, Dataproc, Pub/Sub, CI/CD tools
Responsibilities
Design and implement CI/CD pipelines for automated build, test, and deployment; Implement performance tuning (partitioning, broadcast joins, caching, shuffle optimization); Integrate data from multiple sources (databases, APIs, cloud storage, streaming); Migrate legacy data stores to cloud-native architectures; Develop scalable batch and real-time streaming data pipelines; Implement data governance, data quality checks, and secure data access controls.
Seniority
Mid-Senior, hands-on IC