Senior Data Engineering
Core
Own data pipeline health, evolution, and reliability for systems feeding ENDUR and Power BI reporting layers.
Role type
Senior hands-on data engineer
Builds
Airflow-based data pipelines, Power BI data models, and reporting solutions
Domain
Energy trading (ETRM) and BFSI risk/trading data platforms
Required skills
Apache Airflow, Python (OOP, unit testing), Advanced SQL, Apache Spark, Power BI (data modeling, DAX, RLS), on-prem/hybrid lakehouse environments (MinIO, Apache Iceberg, Trino), CI/CD, test automation
Preferred skills
Energy trading or BFSI risk/trading data platforms experience, monitoring/alerting/reconciliation frameworks, Kubernetes, high-pressure incident response
Technologies
Apache Airflow, Python, Apache Spark, Power BI, MinIO, Apache Iceberg, Trino, Kubernetes
Responsibilities
Maintain and evolve Airflow-based pipelines pulling from ENDUR batches; Detect and resolve pipeline failures and data mismatches; Build Power BI data models and reporting solutions; Author new pipeline transformations and optimize Spark jobs; Drive root cause analysis and implement preventive solutions; Mentor junior engineers and enforce standards
Seniority
Senior, hands-on IC
