Data Engineers (w/m/d)
Core
Design and implement data lake architectures, ETL/ELT processes, and integrate data from diverse sources (streaming, APIs, SQL) to support analytics and BI services.
Role type
Data Engineer
Builds
Data Lake architectures, ETL/ELT pipelines, and data integration solutions
Domain
Data Engineering, Microsoft Cloud (Azure), Business Intelligence
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Spark, NoSQL, Data Lakes, Cloud Platforms (Azure), ETL/ELT
Preferred skills
Python, Scala, Java, Agile/SCRUM
Technologies
NoSQL, SQL, Spark, Power BI, Microsoft Azure, Hadoop
Responsibilities
Integrate data from various sources (streaming, APIs, sensors, SQL databases); Conceive and implement Data Lake architectures; Conceive and implement ETL/ELT processes; Conceive and implement logging and monitoring mechanisms; Estimate project effort, plan resources, and lead projects.