Senior Data Engineer - Google Cloud Platform Bad Friedrichshall (gn)
Core
Designing, developing, and operating high-performance batch and streaming data flows in a central Google Cloud Data Lakehouse for analytics and machine learning use cases.
Role type
Senior Data Engineer (GCP)
Builds
Centralized data lakehouse infrastructure, real-time and batch data processing pipelines, and orchestration tools for the Schwarz Group's retail and production divisions.
Domain
Retail / E-commerce / Data Engineering / Cloud Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Google Cloud Platform (GCP), Apache Kafka, Python, Apache Spark, Kubernetes, Docker, Apache Airflow, dbt, Git, CI/CD, automated testing
Preferred skills
Data Lakehouse architecture, Data Mesh concepts, real-time data processing optimization
Technologies
Google Cloud Platform, Apache Kafka, Python, Apache Spark, Kubernetes, Docker, Apache Airflow, dbt
Responsibilities
Conceive, develop, and maintain high-performance batch and streaming data flows; optimize GCP cloud architecture for scalability; implement automated data validation processes; collaborate with Data Scientists and Product Owners to translate business requirements into technical solutions.
Seniority
Senior, hands-on IC