Data Engineer
Core
Design, build, and maintain data engineering solutions on Google's Cloud ecosystem for batch and real-time data pipelines, data migration, and data layer design.
Role type
Data Engineer (Google Cloud)
Builds
Data pipelines, data warehouses, data lakes, and optimized data layers
Domain
Cloud data engineering, Google Cloud Platform
Deliverable
production ML models | product features | infrastructure
Required skills
Data modeling, ETL/ELT design patterns, data pipeline performance tuning, data governance, security principles, advanced SQL, Python programming, distributed data processing frameworks (Spark, Beam, Flink), DevOps practices, CI/CD for data workflows, version control, testing frameworks, AI-assisted development tools
Preferred skills
Experience with other cloud platforms (AWS, Azure)
Technologies
Google Cloud Platform, DataProc, DataFlow, PubSub, BigQuery, Big Table, Cloud Spanner, Cloud Scheduler, Cloud Composer (Airflow), Google Cloud Storage, Apache Beam, Spark, Hadoop
Responsibilities
Design and develop batch and real-time data pipelines for Data Warehouse and Datalake; Build and maintain data engineering solutions using Google Cloud services; Schedule and manage the data platform using Cloud Scheduler and Cloud Composer; Develop and implement data migration solutions; Design and optimize the data layer for efficient storage and retrieval
Seniority
Mid-level (4-6 years experience), hands-on IC
