Intermediate Data Engineer (m/w/d)
Core
Develop and maintain automated data ingestion pipelines for batch and streaming data, supporting modern hybrid data platforms and data quality governance.
Role type
Intermediate Data Engineer
Builds
Automated data pipelines, hybrid data platforms (Lakehouse & DWH), data quality checks
Domain
Software development, Data Engineering, Cloud
Deliverable
production ML models | product features | infrastructure
Required skills
Distributed Computing (Spark/Databricks), Python, SQL, Cloud platforms (Azure/AWS), Docker, Git, Data Lineage
Preferred skills
CI/CD workflows, Data modeling (Partitioning, Star/Snowflake Schema), Data Lake architecture, Testing for data processes, Clean Code Standards
Technologies
Spark, Databricks, Python, SQL, Azure, AWS, Docker, Git
Responsibilities
Develop and maintain automated data ingestion pipelines; Support the expansion of modern hybrid data platforms; Implement schema validations and data quality checks; Work on access controls and data versioning; Optimize data processing performance
Seniority
Intermediate, hands-on IC
