Data & BI Engineer — Commodity Markets Analytics (CTRM Platform)
Core
Building and maintaining the data and BI layer for a CTRM platform serving traders, analysts, and management with real-time market intelligence on crude oil and refined products.
Role type
Senior Data & BI Engineer (Commodity Markets)
Builds
Ingestion pipelines, central commodity data models, and dashboards for price analysis, spreads, cargo flows, and margin.
Domain
Energy trading, Commodity Markets, CTRM
Required skills
SQL, Python (pandas, SQLAlchemy), Data modelling (dimensional, star schemas), dbt, BI tools (Power BI, Tableau, Metabase, Superset), Data quality & reconciliation, Vendor API integration, Coding agent verification
Preferred skills
Market data provider APIs (Kpler, Platts, OPIS, Argus, Bloomberg), Cloud data warehouses (Snowflake, BigQuery, Databricks), Workflow orchestration (Airflow, Prefect, Dagster), CTRM/ETRM systems
Technologies
Python, SQL, dbt, Power BI, Tableau, Metabase, Superset, Snowflake, BigQuery, Databricks, Airflow, Prefect, Dagster, Kpler, Platts, OPIS, Argus, Bloomberg
Responsibilities
Design and build ELT/ETL pipelines from internal systems and external market data providers; Develop and maintain a central commodity data model with consistent units and calendars; Create dashboards and reports for price analysis, spreads, cargo flows, and margin; Ensure data quality, lineage, and reconciliation; Define single agreed definitions for trading, operations, and finance; Translate trader requirements into working analytics; Evaluate and recommend new data sources and tools.
Seniority
Senior, hands-on IC