Data Engineer - Natural Gas
Core
Build and scale data pipelines and scrapers for a new US Natural Gas product, merging data with existing European Gas offerings to support analytics and tracking systems.
Role type
Data Engineer (Natural Gas)
Builds
Data pipelines, scrapers, backend tools, and APIs for natural gas market intelligence
Domain
Energy / Commodities / Maritime
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, PostgreSQL, RESTful APIs, Git, Agile, time-series data, events data, database design, performance optimization, caching
Preferred skills
AWS, Terraform, Airflow, Docker, Kubernetes, hexagonal architecture, medallion architecture, NoSQL, monitoring solutions (Datadog, Grafana)
Responsibilities
Maintain and expand data scrapers; develop backend tools and data pipelines; create documentation for tools and processes; build automated checks for data anomalies; ensure high-performance API distribution; collaborate with analysts on roadmap; test and scale data quality solutions
Seniority
Mid-level, hands-on IC