Senior Data Engineer
Core
Design, develop, and support trusted data products and modern data environments for climate, energy, and water management decisions.
Role type
Senior IC data engineer (Microsoft Fabric)
Builds
Modern data ingestion pipelines, transformation processes, Lakehouses, and Warehouses using Medallion architecture
Domain
Public sector (Environment, Climate Change, Energy, Water)
Deliverable
production ML models | product features
Required skills
Python, PySpark, SQL, Microsoft Fabric, ETL/ELT, Delta Lake, Medallion architecture, Azure DevOps, data quality controls
Preferred skills
Data mesh principles, platform governance, incident resolution, knowledge sharing
Technologies
Microsoft Fabric, Python, PySpark, SQL, Delta Lake, Azure, Azure DevOps
Responsibilities
Design and deliver modern data ingestion pipelines; Build robust transformation processes; Develop reliable data products with strong controls; Monitor pipeline performance and resolve issues; Support and operate the enterprise data platform; Implement and improve platform governance and automation
Seniority
Senior, hands-on IC