Data Engineer
Core
Designing and maintaining scalable Data Lake architecture and pipelines to enable AI/ML predictions and optimization in the water sector.
Role type
Senior Data Engineer (AI/ML infrastructure)
Builds
Scalable data pipelines, feature stores, and analytical datasets for AI models
Domain
Water technology / AI & Machine Learning
Deliverable
production ML models
Required skills
Python, SQL, PySpark, Databricks, Airflow, ETL/ELT pipeline design, Data Lake architecture, MLOps, feature engineering, API integration
Preferred skills
Knowledge of hydraulic models, geospatial data, time-series telemetry
Technologies
PySpark, Spark, Databricks, Airflow
Responsibilities
Define technical strategy and architecture for the Data Lake; Build and maintain analytical models and feature datasets; Design end-to-end data pipelines for water sector sources; Ensure data quality, consistency, and governance; Collaborate with AI Engineers and data scientists to translate model requirements; Lead adoption of data architecture best practices and MLOps; Develop platform capabilities like feature stores; Monitor pipeline performance and resolve data incidents; Document data architectures and transformations.
