Data Engineer (m/w/d)
Core
Designing and optimizing data architectures, pipelines, and ETL processes to ensure data quality, security, and availability for various business units.
Role type
Data Engineer
Builds
Data pipelines, databases, and data lakes
Domain
Data Engineering / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
SQL, NoSQL, Python, Java, Scala, Cloud platforms (AWS, Azure, GCP), Big Data frameworks (Spark, Kafka, Hadoop)
Preferred skills
Experience with Big Data frameworks
Technologies
AWS, Azure, GCP, Spark, Kafka, Hadoop, SQL, NoSQL, Python, Java, Scala
Responsibilities
Develop and optimize data architectures, pipelines, and ETL processes; Build and maintain databases, data lakes, and cloud platforms; Integrate and transform large datasets from various sources; Ensure data quality, security, and availability; Support the selection and implementation of new technologies and tools; Document and continuously improve existing data processes
Seniority
Mid-level to Senior, hands-on IC