Senior Data Engineer (electricityMap)
Core
Building and optimizing large-scale batch and real-time data pipelines to power electricityMap's data insights and emission tracking.
Role type
Senior Data Engineer
Builds
Data pipelines and infrastructure for electricityMap
Domain
Energy / Climate Tech / Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Spark, Apache Beam, Google Cloud Platform, time series data processing, data modeling, data storage, cloud pipeline deployment, testing
Preferred skills
autonomy, problem-solving, empathy
Technologies
Spark, Apache Beam, Google Cloud Platform
Responsibilities
Build large-scale batch and real-time data pipelines; Drive optimization, testing and tooling to improve data quality; Collaborate with software engineers and ML experts to ensure data accuracy
Seniority
Senior, hands-on IC
Rewrite
## About the role
We're facing increasing demand for our data and insights, and to meet this demand we need to improve our data pipeline and other infrastructure. Your job will be to enable this by:
- Building large-scale batch and real-time data pipelines with data processing frameworks like Spark, Apache Beam and the Google Cloud Platform
- Driving optimization, testing and tooling to improve data quality and ensure reliability
- Collaborating with other software engineers, ML experts and community experts to ensure that electricityMap delivers the most accurate data
## About you
We're looking for a purpose-driven and empathetic data engineer who is comfortable with autonomy and tackling challenging problems that will help the world understand and reduce its emissions.
Your personality, breadth of experience and your hunger to learn means more than years of experience. Even if you don't fullfill all the skills listed below, do apply!
As the ideal future teammate, you
- Know how to work with and process high volumes of time series data
- Are knowledgeable about data modeling, data access, and data storage techniques
- Have experience deploying and maintaining data pipelines in the cloud
- Have experience deploying and testing
Sourced via wellfound · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.