Data Engineer- Senior Associate- Energy & Commodities
Core
Design, implement, and test scalable data pipelines, ETL/ELT processes, and data storage solutions to support data-driven decision-making.
Role type
Senior Data Engineer
Builds
Scalable data platforms and technology solutions
Domain
Enterprise data engineering, Cloud (Azure, AWS, GCP), Big Data
Deliverable
production ML models
Required skills
ETL/ELT design and implementation, Python, SQL, Big Data technologies (Spark, Hadoop, Kafka, Flink), Cloud platforms (Azure, AWS, GCP), Data modeling and schema design, Workflow orchestration (Airflow, Data Factory), CI/CD practices
Preferred skills
SAP data sources and integrations, Modern data engineering tools (Databricks, Snowflake, Big Query, Synapse), Version control (Git)
Responsibilities
Design and implement data pipelines and storage solutions, Build and maintain high-performance pipelines for structured and unstructured data, Collaborate with data scientists and analysts to deliver clean data, Automate provisioning and environment management, Create and support APIs and data services, Ensure solutions meet scalability, performance, and governance requirements
Seniority
Senior, hands-on IC
