Mid-Senior Data Engineer (GCP, Python, BigQuery)
Core
Designing and building a modern, cloud-native data platform on Google Cloud to process large volumes of operational, auditing, and passenger data for real-time insights and external Data-as-a-Service products.
Role type
Mid-Senior Data Engineer (GCP, Python, BigQuery)
Builds
Serverless Python microservices, ETL/ELT pipelines, unified data lakes, and secure external APIs for partners and operators.
Domain
B2B SaaS / Rail Travel / Accessibility Technology
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Google Cloud Platform (GCP), BigQuery, Cloud Run, Cloud SQL, Terraform, ETL/ELT pipeline design, data modeling (dbt, Dataform), API management (OAuth 2.0, API Gateway), CI/CD
Preferred skills
FastAPI, asynchronous workers (Cloud Tasks/PubSub), Looker/Looker Studio, regulated industry experience, legacy codebase migration (Ruby on Rails), REST API design
Technologies
Google Cloud Platform, BigQuery, Cloud Run, Cloud SQL, Terraform, FastAPI, dbt, Dataform, OAuth 2.0, API Gateway, Cloud Tasks, PubSub, Looker, Looker Studio, Ruby on Rails
Responsibilities
Architect and build serverless Python microservices on Google Cloud Run; Build and maintain robust ETL/ELT pipelines streaming data into BigQuery; Write clean, performant SQL to transform raw data into curated datasets; Manage secure, high-throughput external APIs; Utilize Terraform to deploy, secure, and monitor GCP environments.
Seniority
Mid-Senior, hands-on IC
