Data Engineer
Core
Building, optimizing, and supporting end-to-end data pipelines and data products on Google Cloud Platform (GCP) within a data mesh context.
Role type
Data Engineer
Builds
Data pipelines and data products on GCP
Domain
Cloud infrastructure and data engineering
Deliverable
production ML models | infrastructure
Required skills
GCP platform expertise, DevOps mindset, CI/CD pipeline management, Terraform, Cloud infrastructure management, data product design, data mesh integration, technical debt reduction
Preferred skills
GCP services (Cloud Run), large-scale data processing (Spark, Beam, Hive), data formats (Avro, Parquet, Iceberg, Hudi), DBT, data governance and cataloging, data visualization
Technologies
GCP, Terraform, Cloud Run, Spark, Beam, Hive, Avro, Parquet, Iceberg, Hudi, DBT
Responsibilities
Manage CI/CD pipelines and Cloud infrastructure, design data products as independent deployment units, collaborate with Product Managers to define data product vision, partner with product teams for data sharing and integration, drive continuous improvement in data engineering practices
Seniority
Mid-level, hands-on IC
