DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Comparing quantile regression forest and mixture density long short-term memory models for probabilistic post-processing of satellite precipitation-driven streamflow simulations

Journal Article · · Hydrology and Earth System Sciences (Online)

Abstract. Deep learning (DL) and machine learning (ML) are widely used in hydrological modelling, which plays a critical role in improving the accuracy of hydrological predictions. However, the trade-off between model performance and computational cost has always been a challenge for hydrologists when selecting a suitable model, particularly for probabilistic post-processing with large ensemble members. This study aims to systematically compare the quantile regression forest (QRF) model and countable mixtures of asymmetric Laplacians long short-term memory (CMAL-LSTM) model as hydrological probabilistic post-processors. Specifically, we evaluate their ability in dealing with biased streamflow simulations driven by three satellite precipitation products across 522 nested sub-basins of the Yalong River basin in China. Model performance is comprehensively assessed using a series of scoring metrics from both probabilistic and deterministic perspectives. Our results show that the QRF model and the CMAL-LSTM model are comparable in terms of probabilistic prediction, and their performances are closely related to the flow accumulation area (FAA) of the sub-basin. The QRF model outperforms the CMAL-LSTM model in most sub-basins with smaller FAA, while the CMAL-LSTM model has an undebatable advantage in sub-basins with FAA larger than 60 000 km2 in the Yalong River basin. In terms of deterministic predictions, the CMAL-LSTM model is preferred, especially when the raw streamflow is poorly simulated and used as input. However, setting aside the differences in model performance, the QRF model with 100-member quantiles demonstrates a noteworthy advantage by exhibiting a 50 % reduction in computation time compared to the CMAL-LSTM model with the same ensemble members in all experiments. As a result, this study provides insights into model selection in hydrological post-processing and the trade-offs between model performance and computational efficiency. The findings highlight the importance of considering the specific application scenario, such as the catchment size and the required accuracy level, when selecting a suitable model for hydrological post-processing.

Sponsoring Organization:
USDOE
Grant/Contract Number:
DE‐IA0000018
OSTI ID:
2246985
Journal Information:
Hydrology and Earth System Sciences (Online), Journal Name: Hydrology and Earth System Sciences (Online) Vol. 27 Journal Issue: 24; ISSN 1607-7938
Publisher:
Copernicus GmbHCopyright Statement
Country of Publication:
Germany
Language:
English

References (96)

Global Satellite Mapping of Precipitation (GSMaP) Products in the GPM Era book January 2020
Hydrologic multi-model ensemble predictions using variational Bayesian deep learning journal January 2022
Real-time bias adjustment for satellite-based precipitation estimates over Mainland China journal May 2021
Generating Ensemble Streamflow Forecasts: A Review of Methods and Approaches Over the Past 40 Years journal July 2021
HEPEX: The Hydrological Ensemble Prediction Experiment journal October 2007
Component analysis of errors in satellite-based precipitation estimates journal January 2009
Achieving effective calibration of precipitation forecasts over a continental scale journal June 2021
G‐RUN ENSEMBLE: A Multi‐Forcing Observation‐Based Global Runoff Reanalysis journal May 2021
Bayesian LSTM With Stochastic Variational Inference for Estimating Model Uncertainty in Process‐Based Hydrological Models journal September 2021
Propagation of satellite precipitation uncertainties through a distributed hydrologic model: A case study in the Tocantins–Araguaia basin in Brazil journal August 2015
A comprehensive review of deep learning applications in hydrology and water resources journal August 2020
The CHRS Data Portal, an easily accessible public repository for PERSIANN global satellite precipitation data journal January 2019
Machine learning for precipitation forecasts post-processing — Multi-model comparison and experimental investigation journal October 2021
An improved long short-term memory network for streamflow forecasting in the upper Yangtze River journal February 2020
Comparing machine learning and deep learning models for probabilistic post-processing of satellite precipitation-driven streamflow simulation posted_content November 2022
Caravan - A global community dataset for large-sample hydrology journal January 2023
A Review on Theoretical Consideration and Types of Models in Hydrology journal August 2012
Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling journal October 2009
A process-based diagnostic approach to model evaluation: Application to the NWS distributed hydrologic model: PROCESS-BASED DIAGNOSTIC EVALUATION OF HYDROLOGIC MODEL journal September 2008
Evaluating raw ensembles with the continuous ranked probability score journal February 2012
Error Characteristics and Scale Dependence of Current Satellite Precipitation Estimates Products in Hydrological Modeling journal August 2021
Impact of Hydrological Uncertainty on Water Management Decisions journal September 2016
Towards learning universal, regional, and local hydrological behaviors via machine learning applied to large-sample datasets journal January 2019
Calibrated Ensemble Forecasts Using Quantile Regression Forests and Ensemble Model Output Statistics journal June 2016
How do GPM IMERG precipitation estimates perform as hydrological model forcing? Evaluation for 300 catchments across Mainland China journal May 2019
PERSIANN Dynamic Infrared–Rain Rate Model (PDIR) for High-Resolution, Real-Time Satellite Precipitation Estimation journal March 2020
A philosophical basis for hydrological uncertainty journal May 2016
User-friendly workflows for catchment modelling: Towards reproducible SWAT+ model studies journal December 2020
Impact of radar‐rainfall error structure on estimated flood magnitude across scales: An investigation based on a parsimonious distributed hydrological model journal October 2012
Continuous hydrograph synthesis with an API‐type hydrologic model journal October 1969
On the spatio-temporal analysis of hydrological droughts from global hydrological models journal September 2011
Applications of Deep Learning in Hydrology book August 2021
A review on statistical postprocessing methods for hydrometeorological ensemble forecasting journal September 2017
Identification of a Constrained Nonlinear Hydrological System Described by Volterra Functional Series journal September 1991
The Great Lakes Runoff Intercomparison Project Phase 4: the Great Lakes (GRIP-GL) journal July 2022
Development of distributed time-variant gain model for nonlinear hydrological systems journal June 2005
High-quality reconstruction of China’s natural streamflow journal March 2022
A review of SWAT applications, performance and future needs for simulation of hydro-climatic extremes journal September 2020
Improving kinematic wave routing scheme in Community Land Model journal November 2012
A hydrologic post-processor for ensemble streamflow predictions journal February 2011
Random forests-based error-correction of streamflow from a large-scale hydrological model: Using model state variables to estimate error terms journal February 2022
Hydrologic post-processing of MOPEX streamflow simulations journal January 2014
A note on leveraging synergy in multiple meteorological data sets with deep learning for rainfall–runoff modeling journal January 2021
Sensitivity Analysis‐Based Automatic Parameter Calibration of the VIC Model for Streamflow Simulations Over China journal January 2020
Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios journal March 2012
NeuralHydrology — A Python library for Deep Learning research in hydrology journal March 2022
Quantile regression as a generic approach for estimating uncertainty of digital soil maps produced from machine-learning journal October 2021
Quantile-Based Hydrological Modelling journal December 2021
A unified approach for process‐based hydrologic modeling: 1. Modeling concept journal April 2015
Changing ideas in hydrology — The case of physically-based models journal January 1989
Comparison analysis of six purely satellite-derived global precipitation estimates journal February 2020
The Data Synergy Effects of Time‐Series Deep Learning Models in Hydrology journal April 2022
Probabilistic forecasts, calibration and sharpness journal April 2007
CNRD v1.0: A High-Quality Natural Runoff Dataset for Hydrological and Climate Studies in China journal May 2021
Multiscale error analysis, correction, and predictive uncertainty estimation in a flood forecasting system journal July 2011
Learning to Correct Climate Projection Biases journal October 2021
A Bayesian joint probability modeling approach for seasonal forecasting of streamflows at multiple sites journal May 2009
From engineering hydrology to Earth system science: milestones in the transformation of hydrologic science journal January 2018
Forecast Verification book December 2011
Post‐Processing the National Water Model with Long Short‐Term Memory Networks for Streamflow Predictions and Model Diagnostics journal November 2021
Improving Rain/No-Rain Detection Skill by Merging Precipitation Estimates from Different Sources journal October 2020
Drainage network extraction from a high-resolution DEM using parallel programming in the .NET Framework journal December 2017
Uncovering Flooding Mechanisms Across the Contiguous United States Through Interpretive Deep Learning on Representative Catchments journal January 2022
A strategy to overcome adverse effects of autoregressive updating of streamflow forecasts journal January 2015
Hydrological post-processing using stacked generalization of quantile regression algorithms: Large-scale application over CONUS journal October 2019
Post-processing of ensemble forecasts in low-flow period journal November 2014
Precipitation forecasts and their uncertainty as input into hydrological models journal October 2005
Development of reservoir operation functions in SWAT+ for national environmental assessments journal April 2020
Deep learning, explained: Fundamentals, explainability, and bridgeability to process-based modelling journal October 2021
Improving Global Monthly and Daily Precipitation Estimation by Fusing Gauge Observations, Remote Sensing, and Reanalysis Data Sets journal March 2020
A 500-year annual runoff reconstruction for 14 selected European catchments journal September 2022
Uncertainty quantification for hydrological models based on neural networks: the dropout ensemble journal February 2021
Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules journal July 2011
The importance of hydrological uncertainty assessment methods in climate change impact studies journal August 2014
Uncertainties in coastal flood risk assessments in small island developing states journal September 2020
QRF4P‐NRT: Probabilistic Post‐Processing of Near‐Real‐Time Satellite Precipitation Estimates Using Quantile Regression Forests journal May 2022
Benchmarking data-driven rainfall–runoff models in Great Britain: a comparison of long short-term memory (LSTM)-based models with four lumped conceptual models journal October 2021
From lumped to distributed via semi-distributed: Calibration strategies for semi-distributed hydrologic models journal February 2012
A back-fitting algorithm to improve real-time flood forecasting journal July 2018
Representing Human Water Management in a Land Surface Model Using a Supply/Demand Approach journal April 2021
New Insights Into Error Decomposition for Precipitation Products journal September 2021
PERSIANN Dynamic Infrared–Rain Rate (PDIR-Now): A Near-Real-Time, Quasi-Global Satellite Precipitation Dataset journal December 2020
The Global Precipitation Measurement Mission journal May 2014
Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks journal January 2018
The sensitivity of simulated streamflow to individual hydrologic processes across North America journal January 2022
Future Trends in the Interdependence Between Flood Peaks and Volumes: Hydro‐Climatological Drivers and Uncertainty journal June 2019
River flow forecasting through conceptual models part I — A discussion of principles journal April 1970
Error reduction and representation in stages (ERRIS) in hydrological modelling for ensemble streamflow forecasting journal January 2016
Uncertainty estimation with deep learning for rainfall–runoff modeling journal March 2022
Parameter estimation and uncertainty analysis in hydrological modeling journal December 2021
Global Precipitation Map Using Satellite-Borne Microwave Radiometers by the GSMaP Project: Production and Validation journal July 2007
From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling journal October 2021
Ensemble machine learning paradigms in hydrology: A review journal July 2021
Calibrated ensemble forecasts of the height of new snow using quantile regression forests and ensemble model output statistics journal September 2021
Constraining snowmelt in a temperature-index model using simulated snow densities journal September 2014
A Review of Global Precipitation Data Sets: Data Sources, Estimation, and Intercomparisons journal January 2018