Senior Data Engineer (m/w/d)
Core
Design, develop, and maintain robust ETL/ELT pipelines to capture, integrate, and process structured and unstructured data for forecasting and business intelligence.
Role type
Senior Data Engineer
Builds
Enterprise data framework, data repositories, and data pipelines
Domain
Data Engineering, Data Management, Forecasting
Deliverable
production ML models | product features
Required skills
Python development, SQL, relational databases, data modeling, database performance optimization, software development best practices, Git, ETL/ELT solutions
Preferred skills
Databricks, Spark cluster management, Apache Airflow, DAG development, Big Data ecosystems, Data Lake architectures, IoT platforms, cloud-based data platforms
Responsibilities
Capture, integrate, and process data from internal and external sources; Design, develop, and maintain ETL/ELT pipelines; Monitor and improve data quality through validation, testing, and cleansing; Develop solutions within the enterprise data framework; Monitor production systems and data pipelines; Perform maintenance, troubleshooting, and issue resolution
Seniority
Senior, hands-on IC
