Data Engineer
Core
Build and maintain large-scale data pipelines and infrastructure to support machine learning models, research experiments, and online model deployment for smart energy products.
Role type
Senior IC data engineer (ML infrastructure)
Builds
Production-grade ETL/ELT pipelines, training datasets, and experiment infrastructure for AI/ML models
Domain
Renewable energy / Smart energy technology / AI & Algorithms
Deliverable
production ML models
Required skills
Python, SQL, distributed data processing (Spark, Dask, Ray), cloud data ecosystems (AWS S3, SageMaker, Lambda), data modeling and schema design, workflow orchestration (Airflow), data manipulation libraries (Pandas, Polars)
Preferred skills
Time-series/sensor/IoT/telemetry data, streaming platforms (Kafka), distributed systems (Kubernetes, Docker), hybrid/on-prem architectures
Technologies
Python, SQL, AWS (S3, SageMaker, Lambda), Airflow, Spark, Dask, Ray, Pandas, Polars, Kafka, Kubernetes, Docker, Vertica, Cassandra, MySQL, Redis
Responsibilities
Build and maintain robust data pipelines for ingestion, feature creation, transformation, and storage; Establish best practices for versioning, reproducibility, metadata, and data quality; Build internal Python utilities and APIs to simplify data access; Support experiment infrastructure including batch jobs and evaluation pipelines
Seniority
Senior, hands-on IC
