DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A large-scale comparison of Artificial Intelligence and Data Mining (AI&DM) techniques in simulating reservoir releases over the Upper Colorado Region

Journal Article · · Journal of Hydrology
 [1];  [2];  [2];  [2];  [3];  [3]
  1. Univ. of Oklahoma, Norman, OK (United States); OSTI
  2. Univ. of Oklahoma, Norman, OK (United States)
  3. China Institute of Water Resources and Hydropower Research (IWHR) (China)

In recent years, the Artificial Intelligence and Data Mining (AI&DM) models have become popular tools in assisting various aspects of reservoir operation. However, the practical uses are still rarely reported. Comparison experiment of many AI&DM models over a large number of reservoir cases is particularly valuable to help reservoir operators first examine the usefulness and transferability of different AI&DM models, and then identify the most stable and reliable AI&DM model in assist of various decision-making processes. In this study, a total of 12 AI&DM models with different parameterizations and simulation scenarios are comprehensively tested out and compared in simulating the controlled reservoir outflows of 33 reservoir cases over the Upper Colorado Region, United States. Results show that the Random Forecast and the Long-Short-Term-Memory model could consistently derive the best statistical performance than other models under the baseline simulation scenario. The employed AI&DM models could obtain satisfactory statistical interquartile ranges (25–75%) between [0.6–0.9], [0.3–0.8], and [0.2–0.8], for CORR, NSE, and KGE measurements, respectively, and [1.5–6.5], [–15 to 20], and [0.5–8.5] for the normalized RMSE, PBIAS and RSR measurements, respectively. Results also show Multi-Layer Perceptron model and Extreme Gradient Boosting Tree Algorithm produced more stable and superior performance than other models under more complex input scenarios. We also found that the performance of different AI&DM models are closely relevant to the reservoir elevations, sizes, and functionalities. Discussions were made about the sensitivity of AI&DM models’ parameterizations and the key advantages of AI&DM models over the rule-based reservoir models. We further identify that the main advantage of AI&DM models is the flexibility in designing input structures, whereas the rule-based simulation model is rather limited. Future studies were suggested regarding the best way reservoir operators and researchers could use, select, and apply different AI&DM models in simulating reservoir releases under different natural and modeling environments. Finally, this comparison study also serves as a reference and a piece of groundwork for further promoting the practical uses of AI&DM models in assisting reservoir operation.

Research Organization:
Univ. of California, Oakland, CA (United States)
Sponsoring Organization:
National Key Research and Development Program of China; National Science Foundation (NSF); USDOE; USDOE Office of International Affairs (IA)
Grant/Contract Number:
IA0000018
OSTI ID:
1977301
Journal Information:
Journal of Hydrology, Journal Name: Journal of Hydrology Journal Issue: C Vol. 602; ISSN 0022-1694
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (163)

Simulating California reservoir operation using the classification and regression-tree algorithm combined with a shuffled cross-validation scheme: SIMULATING RESERVOIR OPERATION IN CALIFORNIA journal March 2016
Developing reservoir monthly inflow forecasts using artificial intelligence and climate phenomenon information: RESERVOIR INFLOW FORECASTS journal April 2017
Short-term inflow forecasting using an artificial neural network model journal January 2002
Short-term stream water temperature observations permit rapid assessment of potential climate change impacts: RAPID ASSESSMENT OF CLIMATE CHANGE IMPACTS ON STREAM WATER TEMPERATURE journal October 2014
Non‐stationary bias correction of monthly CMIP5 temperature projections over China using a residual‐based bagging tree model journal August 2017
An Introduction to Statistical Learning book January 2013
Induction of decision trees journal March 1986
A further comparison of splitting rules for decision-tree induction journal January 1992
Support-vector networks journal September 1995
Multivariate decision trees journal April 1995
A logical calculus of the ideas immanent in nervous activity journal December 1943
Output-Sensitive Algorithms for Computing Nearest-Neighbour Decision Boundaries journal January 2005
Methods used for quantifying the prediction uncertainty of artificial neural network based hydrologic models journal December 2016
Monthly runoff forecasting based on LSTM–ALO model journal May 2018
An improved long short-term memory network for streamflow forecasting in the upper Yangtze River journal February 2020
Support vector regression optimized by meta-heuristic algorithms for daily streamflow prediction journal September 2020
Application of penalized linear regression and ensemble methods for drought forecasting in Northeast China journal June 2019
Multi-criterion model ensemble of CMIP5 surface air temperature over China journal May 2017
Groundwater-level prediction using multiple linear regression and artificial neural network techniques: a comparative assessment journal October 2013
Real-time reservoir operation using data mining techniques journal September 2018
Decision-tree analysis on optimal release of reservoir storage under typhoon warnings journal July 2007
Optimal Reservoir Operation Using Multi-Objective Evolutionary Algorithm journal June 2006
Robust Methods for Identifying Optimal Reservoir Operation Strategies Using Deterministic and Stochastic Formulations journal January 2010
Daily Outflow Prediction by Multi Layer Perceptron with Logistic Sigmoid and Tangent Sigmoid Activation Functions journal March 2010
Clustered K Nearest Neighbor Algorithm for Daily Inflow Forecasting journal December 2010
Discretized and Continuous Target Fields for the Reservoir Release Rules During Floods journal June 2012
Daily Forecasting of Dam Water Levels: Comparing a Support Vector Machine (SVM) Model With Adaptive Neuro Fuzzy Inference System (ANFIS) journal June 2013
Operating Rules Derivation of Jinsha Reservoirs System with Parameter Calibrated Support Vector Regression journal May 2014
Modelling Intelligent Water Resources Allocation for Multi-users journal January 2016
Development and Implementation of Support Vector Machine Regression Surrogate Models for Predicting Groundwater Pumping-Induced Saltwater Intrusion into Coastal Aquifers journal February 2018
Artificial Neural Network and Support Vector Machine Models for Inflow Prediction of Dam Reservoir (Case Study: Zayandehroud Dam Reservoir) journal April 2019
GECA Proposed Ensemble–KNN Method for Improved Monthly Runoff Forecasting journal January 2020
Long short-term memory (LSTM) recurrent neural network for low-flow hydrological time series forecasting journal July 2019
Optimal water and waste load allocation in reservoir–river systems: a case study journal October 2013
River flow forecasting through conceptual models part I — A discussion of principles journal April 1970
Rainfall forecasting in space and time using a neural network journal August 1992
Artificial neural network models of knowledge representation in chemical engineering journal September 1988
Back-propagation neural networks for modeling complex systems journal January 1995
Alternative k-nearest neighbour rules in supervised pattern recognition journal January 1982
Daily reservoir inflow forecasting using artificial neural networks with stopped training approach journal May 2000
Short term streamflow forecasting using artificial neural networks journal January 1999
Extracting decision trees from trained neural networks journal December 1999
Stochastic gradient boosting journal February 2002
Intelligent reservoir operation system based on evolving artificial neural networks journal June 2008
The role of hydrologic information in reservoir operation – Learning from historical releases journal December 2008
Short-term optimal operation of water systems using ensemble forecasts journal September 2014
A forecast-driven decision-making model for long-term operation of a hydro-wind-photovoltaic hybrid system journal June 2021
Performance evaluation of artificial neural network approaches in forecasting reservoir inflow journal June 2012
Support vector machine applications in the field of hydrology: A review journal June 2014
Prediction of hydraulics performance in drain envelopes using Kmeans based multivariate adaptive regression spline journal March 2021
Exposure assessment models for elemental components of particulate matter in an urban environment: A comparison of regression and random forest approaches journal February 2017
A comparative study on the predictive ability of the decision tree, support vector machine and neuro-fuzzy models in landslide susceptibility mapping using GIS journal February 2013
Methods used for the development of neural networks for the prediction of water resource variables in river systems: Current status and future directions journal August 2010
Data-driven dynamic emulation modelling for the optimal management of environmental systems journal June 2012
Comparing lazy and eager learning models for water level forecasting in river-reservoir basins of inundation regions journal January 2015
Improving the multi-objective evolutionary optimization algorithm for hydropower reservoir operations in the California Oroville–Thermalito complex journal July 2015
An enhanced artificial neural network with a shuffled complex evolutionary global optimization with principal component analysis journal December 2017
Groundwater level forecasting using artificial neural networks journal July 2005
Support vector regression for real-time flood stage forecasting journal September 2006
Forecasting of hydrologic time series with ridge regression in feature space journal January 2007
Support vector machine-based models for hourly reservoir inflow forecasting during typhoon-warning periods journal June 2009
Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling journal October 2009
Climate informed monthly streamflow forecasts for the Brazilian hydropower network using a periodic ridge regression model journal January 2010
Hydrological time series modeling: A comparison between adaptive neuro-fuzzy, neural network and autoregressive techniques journal June 2012
Advancing monthly streamflow prediction accuracy of CART models using ensemble learning paradigms journal January 2013
Comparison of the ARMA, ARIMA, and the autoregressive artificial neural network models in forecasting the monthly inflow of Dez dam reservoir journal January 2013
Streamflow forecasting using functional regression journal July 2016
Multi-objective reservoir operation during flood season considering spillway optimization journal September 2017
Simulation and forecasting of streamflows using machine learning models coupled with base flow separation journal September 2018
Modeling and simulating of reservoir operation using the artificial neural network, support vector regression, deep learning algorithm journal October 2018
Daily streamflow prediction using optimally pruned extreme learning machine journal October 2019
Deriving reservoir operation rule based on Bayesian deep learning method considering multiple uncertainties journal December 2019
Least square support vector machine and multivariate adaptive regression splines for streamflow prediction in mountainous basin using hydro-meteorological data as inputs journal July 2020
Monthly runoff time series prediction by variational mode decomposition and support vector machine based on quantum-behaved particle swarm optimization journal April 2020
Exploring a Long Short-Term Memory based Encoder-Decoder framework for multi-step-ahead flood forecasting journal April 2020
Comparison of eight filter-based feature selection methods for monthly streamflow forecasting – Three case studies on CAMELS data sets journal July 2020
Long lead-time daily and monthly streamflow forecasting using machine learning methods journal November 2020
Simulating runoff under changing climatic conditions: A comparison of the long short-term memory network with two conceptual hydrologic models journal January 2021
Can artificial intelligence and data-driven machine learning models match or even replace process-driven hydrologic models for streamflow simulation?: A case study of four watersheds with different hydro-climatic regions across the CONUS journal July 2021
Framewise phoneme classification with bidirectional LSTM and other neural network architectures journal July 2005
Modeling and predicting the electricity production in hydropower using conjunction of wavelet transform, long short-term memory and random forest models journal June 2021
Random Forests journal January 2001
An Empirical Comparison of Pruning Methods for Decision Tree Induction journal January 1989
A tutorial on support vector regression journal August 2004
Evaluating the use of “goodness-of-fit” Measures in hydrologic and hydroclimatic model validation journal January 1999
Summarizing multiple aspects of model performance in a single diagram journal April 2001
Derived operating rules for a reservoir operation system: Comparison of decision trees, neural decision trees and fuzzy decision trees: DERIVED OPERATING RULES FOR RESERVOIR OPERATION journal February 2008
Predicting monthly streamflow using data-driven models coupled with data-preprocessing techniques: PREDICTING MONTHLY STREAMFLOW USING DATA-DRIVEN MODELS journal August 2009
Tree-based reinforcement learning for optimal water reservoir operation: FITTED journal September 2010
Comparison of multiple linear and nonlinear regression, autoregressive integrated moving average, artificial neural network, and wavelet artificial neural network methods for urban water demand forecasting in Montreal, Canada: WATER DEMAND FORECASTING USING WAVELET-NEURAL NETWORKS journal January 2012
Identifying effective forecast horizon for real-time reservoir operation under a limited inflow forecast: EFFECTIVE FORECAST HORIZON IDENTIFICATION journal January 2012
A Rainfall‐Runoff Model With LSTM‐Based Sequence‐to‐Sequence Learning journal January 2020
Challenges in Applying Machine Learning Models for Hydrological Inference: A Case Study for Flooding Events Across Germany journal May 2020
Ensemble‐Based Neural Network Modeling for Hydrologic Forecasts: Addressing Uncertainty in the Model Structure and Input Variable Selection journal June 2020
Evaluation of Methods for Causal Discovery in Hydrometeorological Systems journal July 2020
Artificial Neural Network Modeling of the Rainfall-Runoff Process journal October 1995
Operating rules for multireservoir systems journal April 1997
A simulation model for operating a multipurpose multireservoir system journal April 1976
Study of a complex water resources system with screening and simulation models journal August 1981
Reservoir Management and Operations Models: A State-of-the-Art Review journal December 1985
Learning representations by back-propagating errors journal October 1986
What is a support vector machine? journal December 2006
Learning to forget: continual prediction with LSTM conference January 1999
Operational Planning for California Water System journal January 1986
Network Flow Algorithm Applied to California Aqueduct Simulation journal March 1989
Derived Operating Rules for Reservoirs in Series or in Parallel journal May 1999
Application of ANN for Reservoir Inflow Prediction and Operation journal September 1999
Water Reservoir Control with Data Mining journal January 2003
Optimal Operation of Multireservoir Systems: State-of-the-Art Review journal March 2004
CalSim: Generalized Model for Reservoir System Analysis journal November 2004
Artificial Neural Networks in Hydrology. I: Preliminary Concepts journal April 2000
Artificial Neural Networks in Hydrology. II: Hydrologic Applications journal April 2000
Multivariate Reservoir Inflow Forecasting Using Temporal Neural Networks journal October 2001
River Flow Modeling Using Artificial Neural Networks journal January 2004
Streamflow Forecasting Using Different Artificial Neural Network Algorithms journal September 2007
Simulation of Methyl Tertiary Butyl Ether Concentrations in River-Reservoir Systems Using Support Vector Regression journal June 2016
Simulating Hydropower Discharge using Multiple Decision Tree Methods and a Dynamical Model Merging Technique journal February 2020
Ridge Regression in Practice journal February 1975
An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression journal August 1992
Ridge Regression: Biased Estimation for Nonorthogonal Problems journal February 1970
Better Bootstrap Confidence Intervals journal March 1987
WEAP21—A Demand-, Priority-, and Preference-Driven Water Planning Model: Part 1: Model Characteristics journal December 2005
Derivation of water and power operating rules for multi-reservoirs journal December 2015
Multivariate modelling of water resources time series using artificial neural networks journal April 1995
An artificial neural network approach to rainfall-runoff modelling journal February 1998
Performance evaluation of ANNs and an M5 model tree in Sattarkhan Reservoir inflow prediction journal February 2017
Short-term management of hydropower assets of the Federal Columbia River Power System journal January 2014
Assessment of CMIP5 climate models and projected temperature changes over Northern Eurasia journal May 2014
Artificial neural networks: a tutorial journal March 1996
An overview of statistical learning theory journal January 1999
Nearest neighbor pattern classification journal January 1967
An Introduction to the Bootstrap journal June 2001
Fifty Years of Classification and Regression Trees: Fifty Years of Classification and Regression Trees journal June 2014
Advanced Statistics: Linear Regression,Part I: Simple Linear Regression journal January 2004
Riverware: a Generalized tool for Complex Reservoir System Modeling1 journal August 2001
Hydrological Modeling of the Iroquois River Watershed Using hspf and swat journal April 2005
Geometric Proximity Graphs for Improving Nearest Neighbor Methods in Instance-Based Learning and data Mining journal April 2005
The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions journal April 1998
A training algorithm for optimal margin classifiers conference January 1992
Overfitting and undercomputing in machine learning journal September 1995
XGBoost: A Scalable Tree Boosting System conference January 2016
Freshwater Algal Bloom Prediction by Support Vector Machine in Macau Storage Reservoirs journal January 2012
Long Short-Term Memory journal November 1997
A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures journal July 2019
A comprehensive survey on machine learning for networking: evolution, applications and research opportunities journal June 2018
Advanced Statistics: Linear Regression,Part I: Simple Linear Regression journal January 2004
CART: Classification and Regression Trees book April 2009
Model Evaluation Guidelines for Systematic Quantification of Accuracy in Watershed Simulations journal January 2007
Using support vector machines for long-term discharge prediction journal August 2006
Classification and Regression Trees: a Powerful yet Simple Technique for Ecological data Analysis journal November 2000
Principles of Data Mining journal January 2007
A comparative study of multiple linear regression, artificial neural network and support vector machine for the prediction of dissolved oxygen journal October 2016
Real-Time Flood Control by Tree-Based Model Predictive Control Including Forecast Uncertainty: A Case Study Reservoir in Turkey journal March 2018
Flood Prediction Using Machine Learning Models: Literature Review journal October 2018
Comparison of Multiple Linear Regression, Artificial Neural Network, Extreme Learning Machine, and Support Vector Machine in Deriving Operation Rule of Hydropower Reservoir journal January 2019
Simulating Reservoir Operation Using a Recurrent Neural Network Algorithm journal April 2019
Support Vector Regression Integrated with Fruit Fly Optimization Algorithm for River Flow Forecasting in Lake Urmia Basin journal September 2019
Comparison of Long Short Term Memory Networks and the Hydrological Model in Runoff Simulation journal January 2020
Comparative Analysis of Recurrent Neural Network Architectures for Reservoir Inflow Forecasting journal May 2020
A Model Tree Generator (MTG) Framework for Simulating Hydrologic Systems: Application to Reservoir Routing journal August 2020
Application of a Classifier Based on Data Mining Techniques in Water Supply Operation journal December 2016
Long-Term Streamflow Forecasting Based on Relevance Vector Machine Model journal December 2016
Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks journal January 2018