Data Engineering - Senior Manager
Core
Lead a data engineering team to design, implement, and maintain scalable data pipelines, ETL/ELT processes, and storage solutions for structured and unstructured data.
Role type
Senior Manager, hands-on IC data engineering leader
Builds
Scalable data platforms, pipelines, APIs, and data services
Domain
Data Engineering / Big Data / Cloud
Deliverable
production ML models
Required skills
ETL/ELT design and implementation, Big data ecosystems (Spark, Hadoop, Kafka, Flink), Cloud platforms (Azure, AWS, GCP), Data engineering tools (Databricks, Snowflake, BigQuery, Synapse), Python, Java, SQL, Data modeling and schema design, Workflow orchestration (Airflow, Data Factory), Version control (Git), CI/CD practices
Preferred skills
Energy and Commodities or Financial Services sector background
Technologies
Spark, Hadoop, Kafka, Flink, Azure, AWS, GCP, Databricks, Snowflake, BigQuery, Synapse, Airflow, Data Factory, Python, Java, SQL, Git
Responsibilities
Design and implement data pipelines and ETL/ELT processes, Build and maintain scalable data pipelines for structured and unstructured data, Work with big data technologies and distributed systems, Collaborate with data modelers and data scientists to ensure efficient data flows, Automate provisioning and deployments for data platforms, Create and support APIs and data services
Seniority
Senior, hands-on IC with team leadership
