Data Engineer – Schwerpunkt Programmierung & Datenpipelines* (m/w/d)
Core
Designing and building scalable ETL/ELT data pipelines for batch and streaming processing to transform and model data for diverse consulting clients.
Role type
Senior Data Engineer (Consulting)
Builds
Scalable data pipelines, data models, and infrastructure supporting analytics and ML workflows.
Domain
Consulting, Data Engineering, Cloud Data Platforms
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, Spark/PySpark, Data Modeling (Kimball, Data Vault, Lakehouse), Data Orchestration, CI/CD
Preferred skills
dbt, Airflow, Databricks, Snowflake, Analytical thinking
Technologies
Spark, PySpark, Python, SQL, Airflow, Databricks, Snowflake, dbt
Responsibilities
Develop scalable ETL/ELT pipelines for batch and streaming; Implement data models using Kimball, Data Vault, or Lakehouse principles; Transform and normalize data from various source systems; Orchestrate pipelines with Airflow or similar tools; Support data analysis and ML pipelines; Ensure quality through testing, documentation, and CI/CD.
Seniority
Senior, hands-on IC
