Reporting and Analytics Senior
Core
Design and implement data engineering, ingestion, and curation functions using Google Cloud Platform, focusing on building batch and streaming pipelines.
Role type
Senior Data Engineer (Google Cloud Platform)
Builds
End-to-end batch and streaming data pipelines on GCP
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models | infrastructure
Required skills
Google Cloud Platform (GCP), BigQuery, Java (Expert), Apache Beam, Cloud Dataflow, Apache Airflow, Cloud Composer, SQL
Preferred skills
Python
Technologies
GCP, BigQuery, Java, Python, Apache Beam, Cloud Dataflow, Apache Airflow, Cloud Composer, SQL
Responsibilities
Design and implement data engineering, ingestion, and curation functions; Build Apache Beam/Cloud Dataflow pipelines for batch and streaming; Create end-to-end pipelines using Apache Airflow/Cloud Composer; Implement SQL Standards and various data warehousing scenarios.