Intermediate Data Engineer (m/w/d)
Core
Develop and maintain automated data ingestion pipelines ensuring reliable processing of batch and streaming data.
Role type
Intermediate Data Engineer
Builds
Automated data pipelines, hybrid data platforms (Lakehouse & DWH)
Domain
Data Engineering, Cloud Computing
Deliverable
production ML models
Required skills
Python, SQL, Distributed Computing (Spark/Databricks), Cloud platforms (Azure/AWS), Docker, Git, Data Lineage
Preferred skills
CI/CD, Data Modeling (Star/Snowflake), Data Lake Architecture, Data Testing, Clean Code
Technologies
Spark, Databricks, Azure, AWS, Docker, Git
Responsibilities
Develop and maintain automated data ingestion pipelines; Support building modern hybrid data platforms; Implement schema validations and data quality checks; Support access controls and data versioning; Optimize data processing performance.
Seniority
Intermediate, hands-on IC