Custom Software Engineer
Core
Design, code, and enhance scalable data pipeline components and serverless workloads on Google Cloud Platform.
Role type
Senior Data Engineer (GCP)
Builds
Batch and streaming data pipelines, data transformation workflows, and event-driven processing solutions.
Domain
Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Google Cloud Platform (GCP) Architecture, BigQuery, Pub/Sub, Cloud Run, Terraform, GitLab CI/CD, GCS
Preferred skills
Dataform, Cloud Spanner, Data Mesh, Apache Beam/Dataflow, Apache Airflow/Cloud Composer
Technologies
Python, Terraform, GitLab, Docker, pytest, BigQuery, Pub/Sub, Cloud Functions, Cloud Run, GCS, Cloud Spanner
Responsibilities
Design and implement robust batch and streaming data pipelines; Write clean Python code leveraging GCP client libraries; Provision and manage GCP infrastructure using Terraform; Maintain CI/CD pipelines for automated testing and deployment; Manage containerized workloads on Cloud Run.
Seniority
Senior, hands-on IC
