Senior Data Engineer
Core
Own and evolve end-to-end data pipelines on GCP to serve analytics, ML training, and online inference for a cybersecurity platform.
Role type
Senior Data Engineer (GCP)
Builds
Streaming and batch data pipelines, feature stores, and data quality gates for ML and analytics.
Domain
Cybersecurity / Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
GCP data services (BigQuery, Pub/Sub, Dataflow, Bigtable), Python, SQL, ClickHouse, Airflow, dbt, dimensional modelling, infrastructure as code
Preferred skills
Flink/Spark, legacy warehouse migration, CDC tooling, Vertex AI/Feature Store
Technologies
GCP, BigQuery, Bigtable, Cloud Storage, Pub/Sub, Kafka, Dataflow, Flink, Spark, Airflow, ClickHouse, dbt, Docker, Kubernetes, GitHub Actions
Responsibilities
Design and build batch and streaming pipelines; drive migration from Snowflake to GCP-native stack; own orchestration layer and data quality gates; model data for analytics and ML; partner with ML engineers on feature stores and drift monitoring; integrate third-party SaaS sources; improve data reliability and cost efficiency.
Seniority
Senior, hands-on IC