Data Engineer / Big Data (H/F) – Expert GCP, Kafka, Spark, Scala, Cassandra
Core
Design, optimize, and deploy large-scale distributed data solutions and robust scalable data pipelines.
Role type
Senior Data Engineer (Big Data)
Builds
Production data pipelines and distributed data architectures
Domain
Cloud Data Engineering (GCP)
Deliverable
production ML models | product features | infrastructure
Required skills
GCP (BigQuery, Dataflow, Dataproc), Apache Kafka, Apache Spark, Scala, Python, Cassandra
Preferred skills
Prometheus, Grafana, Airflow, Docker, Kubernetes, CI/CD, IaC
Responsibilities
Design and maintain robust scalable data pipelines; Work on distributed architectures; Optimize data processing on GCP; Collaborate with Data Science and DevOps teams; Ensure performance, reliability, and security of data infrastructure
Seniority
Senior, hands-on IC
Sourced via smartrecruiters · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.