Data Engineer
Core
Design, build, and maintain scalable batch and real-time data pipelines and physical data platforms to support Low Carbon Solutions business use cases.
Role type
Senior Data Engineer (Cloud & Data Platform)
Builds
Scalable data pipelines, physical data models, and enterprise-ready data solutions for analytics and reporting.
Domain
Energy / Low Carbon Solutions / Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, scalable data pipeline development (batch/streaming), data modeling, ETL/ELT design, cloud data platforms, distributed data processing, relational/NoSQL databases, data quality frameworks, CI/CD pipelines
Preferred skills
Azure data services (Data Factory, Synapse, Databricks), Snowflake, Spark, Kafka, Airflow, observability tools, data governance/metadata management, Palantir Foundry
Technologies
Azure, Synapse, Databricks, Snowflake, Spark, Kafka, Airflow, Palantir Foundry
Responsibilities
Design and implement modern cloud-based data solutions; develop and optimize physical data models and data flow diagrams; integrate APIs and data sources; mentor Associate Data Engineers; ensure adherence to data classification and security standards.
Seniority
Senior, hands-on IC with mentorship responsibilities
