Data Engineer - Commodities
Core
Design, implement, and maintain end-to-end ETL workflows to ingest and transform commodities data (weather, supply/demand, storage, transportation) for Portfolio Managers and researchers.
Role type
Senior IC data engineer (commodities)
Builds
Curated data platform and standardized data models supporting advanced analytical and trading capabilities
Domain
Commodities markets + data engineering
Deliverable
production ML models
Required skills
Python, SQL, Airflow, Git, CI/CD, automated testing, data modeling, data quality controls, anomaly detection, schema inference
Preferred skills
Commodities market knowledge, data warehousing, columnar storage, analytic databases, financial services experience
Technologies
Python, SQL, Airflow, GitHub Actions, PyTest
Responsibilities
Design and maintain ETL pipelines; Build standardized data models and schemas; Schedule and monitor data pipelines; Implement validation and anomaly-detection controls; Apply AI for schema inference and data quality; Partner with stakeholders to refine datasets
Seniority
Senior, hands-on IC
