Data Engineer - Data Platform Team
Core
Building, expanding, and maintaining the central data infrastructure and back-end to enable data product building, analytics, and ML efforts for the organization.
Role type
Senior Data Engineer (Data Platform)
Builds
Data infrastructure, central back-end, data serving pipelines, and data marts
Domain
Clean energy technology / Climate tech
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data engineering, infrastructure as code, streaming data, Kafka, schema registry, ELT/ETL pipelines, database architecture, Python, SQL, Java, Terraform, Kubernetes, GitHub CI/CD, Dagster, DBT, DLT, GCP, AWS
Preferred skills
Data mesh concepts, code hygiene practices, holistic system perspective
Technologies
Kafka, GCP, AWS, Dagster, DBT, DLT, Terraform, Kubernetes, Python, SQL, Java
Responsibilities
Develop end-to-end pipelines to ingest, transform, and serve data assets; Build components to enable data mesh distributed ownership; Collaborate with analytics engineers to manage data products; Collaborate with software product teams to enable data autonomy; Introduce practices and tools to improve data reliability and performance; Ingest crucial data to adjust future business strategies
Seniority
Senior, hands-on IC