Senior Data Engineer (m/w/d)
Core
Design and implement a hybrid data platform combining Lakehouse flexibility with Data Warehouse performance for sensor and earth observation data.
Role type
Senior Data Engineer (Hybrid Data Platform & Architecture)
Builds
Hybrid data platforms, data ingestion pipelines, and Data & AI infrastructure (Vector DBs, RAG)
Domain
Software Development / Data Engineering / Earth Observation
Deliverable
production ML models | infrastructure
Required skills
Distributed Computing (Spark ecosystem), Pipeline Engineering (Batch/Streaming), Python/Go, SQL/NoSQL, Cloud Platforms (Azure/AWS), Infrastructure as Code (Terraform), Dimensional Modeling (Star/Snowflake), Data Versioning & Lineage, Docker/Kubernetes, CI/CD
Preferred skills
Data Contracts, RAG Pipeline operations, Agile methodologies
Technologies
Databricks, EMR, Terraform, Docker, Kubernetes, GitHub Actions, Vector Databases
Responsibilities
Conceptualize and implement hybrid data platforms; build and maintain reliable data ingestion pipelines; evolve the data platform by evaluating new Data & AI trends; establish Data Governance, Lineage, and Data Contracts; optimize processing performance via partitioning strategies; enable Data Scientists and engineers with best practices and blueprint architectures
Seniority
Senior, hands-on IC
