Senior Data Engineer
Core
Own and evolve end-to-end data pipelines on GCP, building streaming and batch processes to serve analytics, ML training, and online inference.
Role type
Senior Data Engineer (GCP)
Builds
Data pipelines, feature layers, and data quality gates for ML and AI products
Domain
Cloud data engineering, GCP ecosystem
Deliverable
production ML models
Required skills
Python, SQL, GCP (BigQuery, Dataflow, Pub/Sub), Kafka, Airflow, dbt, Docker, Kubernetes
Preferred skills
Flink, Spark, ClickHouse, Snowflake migration experience
Technologies
GCP, BigQuery, Bigtable, Cloud Storage, Pub/Sub, Kafka, Dataflow, Flink, Spark, Airflow, ClickHouse, dbt, Docker, Kubernetes, GitHub Actions
Responsibilities
Design ELT/ETL processes on BigQuery and ClickHouse; build real-time pipelines on Pub/Sub and Kafka; orchestrate workflows with Airflow; partner with ML engineers on feature pipelines and data drift monitoring; consume and build REST APIs; integrate with third-party SaaS sources; treat infrastructure as code.
Seniority
Senior, hands-on IC