Senior Data Engineer - Data Analytics Plattform (a*)
Core
Design, build, and optimize complex data pipelines and data products for energy supply analytics, from data ingestion to analytical utilization.
Role type
Senior Data Engineer (Data Analytics Platform)
Builds
Data pipelines and data products for energy supply analytics
Domain
Energy sector, cloud data engineering
Deliverable
production ML models | product features
Required skills
Python, PySpark, SQL, Azure, Databricks, Data Warehouse architecture, Lakehouse architecture, Data quality assurance, Metadata management, Technical governance
Preferred skills
Bash scripting, Agile methodologies
Technologies
Azure, Databricks, PySpark, SQL
Responsibilities
Develop, operate, and optimize complex data pipelines and data products; Implement and enhance the existing Data Analytics Platform framework; Contribute to architectural decisions and evaluate technical options; Ensure data quality, testability, security, and stability; Support metadata management and data catalogs; Collaborate with Data Engineers, Analytics Engineers, Data Analysts, and Product Owners
Seniority
Senior, hands-on IC