Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Comparing quantile regression forest and mixture density long short-term memory models for probabilistic post-processing of satellite precipitation-driven streamflow simulations

Journal Article · · Hydrology and Earth System Sciences (Online)

Abstract. Deep learning (DL) and machine learning (ML) are widely used in hydrological modelling, which plays a critical role in improving the accuracy of hydrological predictions. However, the trade-off between model performance and computational cost has always been a challenge for hydrologists when selecting a suitable model, particularly for probabilistic post-processing with large ensemble members. This study aims to systematically compare the quantile regression forest (QRF) model and countable mixtures of asymmetric Laplacians long short-term memory (CMAL-LSTM) model as hydrological probabilistic post-processors. Specifically, we evaluate their ability in dealing with biased streamflow simulations driven by three satellite precipitation products across 522 nested sub-basins of the Yalong River basin in China. Model performance is comprehensively assessed using a series of scoring metrics from both probabilistic and deterministic perspectives. Our results show that the QRF model and the CMAL-LSTM model are comparable in terms of probabilistic prediction, and their performances are closely related to the flow accumulation area (FAA) of the sub-basin. The QRF model outperforms the CMAL-LSTM model in most sub-basins with smaller FAA, while the CMAL-LSTM model has an undebatable advantage in sub-basins with FAA larger than 60 000 km2 in the Yalong River basin. In terms of deterministic predictions, the CMAL-LSTM model is preferred, especially when the raw streamflow is poorly simulated and used as input. However, setting aside the differences in model performance, the QRF model with 100-member quantiles demonstrates a noteworthy advantage by exhibiting a 50 % reduction in computation time compared to the CMAL-LSTM model with the same ensemble members in all experiments. As a result, this study provides insights into model selection in hydrological post-processing and the trade-offs between model performance and computational efficiency. The findings highlight the importance of considering the specific application scenario, such as the catchment size and the required accuracy level, when selecting a suitable model for hydrological post-processing.

Research Organization:
Univ. of California, Oakland, CA (United States)
Sponsoring Organization:
USDOE; USDOE Office of International Affairs (IA)
Grant/Contract Number:
IA0000018
OSTI ID:
2246985
Alternate ID(s):
OSTI ID: 2580422
Journal Information:
Hydrology and Earth System Sciences (Online), Journal Name: Hydrology and Earth System Sciences (Online) Journal Issue: 24 Vol. 27; ISSN 1607-7938
Publisher:
Copernicus GmbHCopyright Statement
Country of Publication:
Germany
Language:
English

References (99)

A unified approach for process‐based hydrologic modeling: 1. Modeling concept journal April 2015
A Review of Global Precipitation Data Sets: Data Sources, Estimation, and Intercomparisons journal January 2018
Applications of Deep Learning in Hydrology book August 2021
Forecast Verification book December 2011
Post-processing of ensemble forecasts in low-flow period journal November 2014
Evaluating raw ensembles with the continuous ranked probability score journal February 2012
A review on statistical postprocessing methods for hydrometeorological ensemble forecasting journal September 2017
Parameter estimation and uncertainty analysis in hydrological modeling journal December 2021
Global Satellite Mapping of Precipitation (GSMaP) Products in the GPM Era book January 2020
An improved long short-term memory network for streamflow forecasting in the upper Yangtze River journal February 2020
Uncertainty quantification for hydrological models based on neural networks: the dropout ensemble journal February 2021
Impact of Hydrological Uncertainty on Water Management Decisions journal September 2016
River flow forecasting through conceptual models part I — A discussion of principles journal April 1970
Changing ideas in hydrology — The case of physically-based models journal January 1989
A review of SWAT applications, performance and future needs for simulation of hydro-climatic extremes journal September 2020
Random forests-based error-correction of streamflow from a large-scale hydrological model: Using model state variables to estimate error terms journal February 2022
Achieving effective calibration of precipitation forecasts over a continental scale journal June 2021
User-friendly workflows for catchment modelling: Towards reproducible SWAT+ model studies journal December 2020
Quantile regression as a generic approach for estimating uncertainty of digital soil maps produced from machine-learning journal October 2021
Deep learning, explained: Fundamentals, explainability, and bridgeability to process-based modelling journal October 2021
From lumped to distributed via semi-distributed: Calibration strategies for semi-distributed hydrologic models journal February 2012
Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling journal October 2009
Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios journal March 2012
Hydrologic post-processing of MOPEX streamflow simulations journal January 2014
Constraining snowmelt in a temperature-index model using simulated snow densities journal September 2014
Propagation of satellite precipitation uncertainties through a distributed hydrologic model: A case study in the Tocantins–Araguaia basin in Brazil journal August 2015
Drainage network extraction from a high-resolution DEM using parallel programming in the .NET Framework journal December 2017
A back-fitting algorithm to improve real-time flood forecasting journal July 2018
How do GPM IMERG precipitation estimates perform as hydrological model forcing? Evaluation for 300 catchments across Mainland China journal May 2019
Hydrological post-processing using stacked generalization of quantile regression algorithms: Large-scale application over CONUS journal October 2019
Comparison analysis of six purely satellite-derived global precipitation estimates journal February 2020
Development of reservoir operation functions in SWAT+ for national environmental assessments journal April 2020
Real-time bias adjustment for satellite-based precipitation estimates over Mainland China journal May 2021
Ensemble machine learning paradigms in hydrology: A review journal July 2021
Hydrologic multi-model ensemble predictions using variational Bayesian deep learning journal January 2022
High-quality reconstruction of China’s natural streamflow journal March 2022
A process-based diagnostic approach to model evaluation: Application to the NWS distributed hydrologic model: PROCESS-BASED DIAGNOSTIC EVALUATION OF HYDROLOGIC MODEL journal September 2008
A Bayesian joint probability modeling approach for seasonal forecasting of streamflows at multiple sites journal May 2009
Component analysis of errors in satellite-based precipitation estimates journal January 2009
Multiscale error analysis, correction, and predictive uncertainty estimation in a flood forecasting system journal July 2011
Impact of radar‐rainfall error structure on estimated flood magnitude across scales: An investigation based on a parsimonious distributed hydrological model journal October 2012
Generating Coherent Ensemble Forecasts After Hydrological Postprocessing: Adaptations of ECC‐Based Methods journal August 2018
Future Trends in the Interdependence Between Flood Peaks and Volumes: Hydro‐Climatological Drivers and Uncertainty journal June 2019
Sensitivity Analysis‐Based Automatic Parameter Calibration of the VIC Model for Streamflow Simulations Over China journal January 2020
Improving the Predictive Skill of a Distributed Hydrological Model by Calibration on Spatial Patterns With Multiple Satellite Data Sets journal January 2020
Improving Global Monthly and Daily Precipitation Estimation by Fusing Gauge Observations, Remote Sensing, and Reanalysis Data Sets journal March 2020
Representing Human Water Management in a Land Surface Model Using a Supply/Demand Approach journal April 2021
Generating Ensemble Streamflow Forecasts: A Review of Methods and Approaches Over the Past 40 Years journal July 2021
G‐RUN ENSEMBLE: A Multi‐Forcing Observation‐Based Global Runoff Reanalysis journal May 2021
New Insights Into Error Decomposition for Precipitation Products journal September 2021
Learning to Correct Climate Projection Biases journal October 2021
The Data Synergy Effects of Time‐Series Deep Learning Models in Hydrology journal April 2022
Bayesian LSTM With Stochastic Variational Inference for Estimating Model Uncertainty in Process‐Based Hydrological Models journal September 2021
Uncovering Flooding Mechanisms Across the Contiguous United States Through Interpretive Deep Learning on Representative Catchments journal January 2022
QRF4P‐NRT: Probabilistic Post‐Processing of Near‐Real‐Time Satellite Precipitation Estimates Using Quantile Regression Forests journal May 2022
Identification of a Constrained Nonlinear Hydrological System Described by Volterra Functional Series journal September 1991
Continuous hydrograph synthesis with an API‐type hydrologic model journal October 1969
From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling journal October 2021
The sensitivity of simulated streamflow to individual hydrologic processes across North America journal January 2022
Caravan - A global community dataset for large-sample hydrology journal January 2023
The CHRS Data Portal, an easily accessible public repository for PERSIANN global satellite precipitation data journal January 2019
A philosophical basis for hydrological uncertainty journal May 2016
Global Precipitation Map Using Satellite-Borne Microwave Radiometers by the GSMaP Project: Production and Validation journal July 2007
Post‐Processing the National Water Model with Long Short‐Term Memory Networks for Streamflow Predictions and Model Diagnostics journal November 2021
Probabilistic forecasts, calibration and sharpness journal April 2007
HEPEX: The Hydrological Ensemble Prediction Experiment journal October 2007
The Global Precipitation Measurement Mission journal May 2014
PERSIANN Dynamic Infrared–Rain Rate Model (PDIR) for High-Resolution, Real-Time Satellite Precipitation Estimation journal March 2020
CNRD v1.0: A High-Quality Natural Runoff Dataset for Hydrological and Climate Studies in China journal May 2021
Improving Rain/No-Rain Detection Skill by Merging Precipitation Estimates from Different Sources journal October 2020
PERSIANN Dynamic Infrared–Rain Rate (PDIR-Now): A Near-Real-Time, Quasi-Global Satellite Precipitation Dataset journal December 2020
Machine learning for precipitation forecasts post-processing — Multi-model comparison and experimental investigation journal October 2021
Calibrated Ensemble Forecasts Using Quantile Regression Forests and Ensemble Model Output Statistics journal June 2016
Forest-Based and Semiparametric Methods for the Postprocessing of Rainfall Ensemble Forecasting journal June 2019
Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules journal July 2011
Development of distributed time-variant gain model for nonlinear hydrological systems journal June 2005
NeuralHydrology — A Python library for Deep Learning research in hydrology journal March 2022
Improving kinematic wave routing scheme in Community Land Model journal November 2012
A comprehensive review of deep learning applications in hydrology and water resources journal August 2020
Error Characteristics and Scale Dependence of Current Satellite Precipitation Estimates Products in Hydrological Modeling journal August 2021
Quantile-Based Hydrological Modelling journal December 2021
A Review on Theoretical Consideration and Types of Models in Hydrology journal August 2012
A hydrologic post-processor for ensemble streamflow predictions journal February 2011
A 500-year annual runoff reconstruction for 14 selected European catchments journal September 2022
On the spatio-temporal analysis of hydrological droughts from global hydrological models journal September 2011
The importance of hydrological uncertainty assessment methods in climate change impact studies journal August 2014
A strategy to overcome adverse effects of autoregressive updating of streamflow forecasts journal January 2015
Error reduction and representation in stages (ERRIS) in hydrological modelling for ensemble streamflow forecasting journal January 2016
Comparing machine learning and deep learning models for probabilistic post-processing of satellite precipitation-driven streamflow simulation posted_content November 2022
From engineering hydrology to Earth system science: milestones in the transformation of hydrologic science journal January 2018
Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks journal January 2018
Towards learning universal, regional, and local hydrological behaviors via machine learning applied to large-sample datasets journal January 2019
A note on leveraging synergy in multiple meteorological data sets with deep learning for rainfall–runoff modeling journal January 2021
Benchmarking data-driven rainfall–runoff models in Great Britain: a comparison of long short-term memory (LSTM)-based models with four lumped conceptual models journal October 2021
Uncertainty estimation with deep learning for rainfall–runoff modeling journal March 2022
The Great Lakes Runoff Intercomparison Project Phase 4: the Great Lakes (GRIP-GL) journal July 2022
Precipitation forecasts and their uncertainty as input into hydrological models journal October 2005
Uncertainties in coastal flood risk assessments in small island developing states journal September 2020
Calibrated ensemble forecasts of the height of new snow using quantile regression forests and ensemble model output statistics journal September 2021

Similar Records

QRF4P-NRT: Probabilistic Post-Processing of Near-Real-Time Satellite Precipitation Estimates Using Quantile Regression Forests
Journal Article · Thu May 05 20:00:00 EDT 2022 · Water Resources Research · OSTI ID:1978587

An experimental seasonal hydrological forecasting system over the Yellow River basin – Part 2: The added value from climate forecast models
Journal Article · Tue Jun 21 20:00:00 EDT 2016 · Hydrology and Earth System Sciences (Online) · OSTI ID:1375771

Related Subjects