Data Engineer
Core
Designing, developing, and maintaining scalable ELT packages and data pipelines to create datasets and support analytics products for a Data & Analytics platform.
Role type
Senior Data Engineer (Data & Analytics Platform Architect)
Builds
Scalable ELT packages, data pipelines, and the logical/physical data models for the Data & Analytics platform.
Domain
Energy industry, Data Engineering, Cloud Data Platforms
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data modeling (conceptual, logical, physical), ELT pipeline design, Azure Lakehouse architecture, Databricks (Spark), Data streaming, System management (monitoring, disaster recovery, backup, automated testing, schema migration, CI/CD), Technical documentation, Incident resolution, Big data strategy
Preferred skills
Industry trend analysis, Strategic advising on data engineering, Ownership mindset, Analytical thinking
Technologies
MS Azure, Databricks, Spark
Responsibilities
Define optimal architecture for the Data & Analytics platform; Manage and monitor data pipelines; Integrate and transform new data sources; Deliver data provisioning to operational applications; Optimize and expand data flows and models; Define and document Data Engineering processes; Assess stability and efficiency of ELT processes; Gather requirements and write technical specifications; Ensure high data quality standards; Resolve incidents related to data interfaces; Expand platform to embed big data capability.
