Senior Data Engineer (m/w/d)
Core
Design and implement a hybrid data platform combining Lakehouse flexibility with Data Warehouse performance for sensor and earth observation data.
Role type
Senior Data Engineer (Platform & Architecture)
Builds
Hybrid data platforms, data ingestion pipelines, and Data & AI infrastructure (Vector DBs, RAG)
Domain
Software development, Data Engineering, Cloud Infrastructure
Deliverable
production ML models
Required skills
Distributed Computing (Spark ecosystem), Pipeline Engineering, Python/Go, SQL/NoSQL, Cloud Platforms (Azure/AWS), Infrastructure as Code (Terraform), Dimensional Modeling, Data Versioning, Containerization (Docker/Kubernetes), CI/CD
Preferred skills
Data Contracts, RAG pipelines, Agile methodologies
Technologies
Databricks, EMR, Terraform, Docker, Kubernetes, GitHub Actions, Vector Databases
Responsibilities
Conceptualize and implement hybrid data platform architecture, build and maintain batch and streaming data pipelines, evaluate new Data & AI trends and tools, establish data governance and observability standards, optimize processing performance, enable Data Scientists and engineers with best practices and blueprints
Seniority
Senior, hands-on IC
