Streamflow simulation in data-scarce basins using Bayesian and physics-informed machine learning models

Journal Article · Thu Mar 25 00:00:00 EDT 2021 · Journal of Hydrometeorology

DOI:https://doi.org/10.1175/jhm-d-20-0082.1· OSTI ID:1808403

Lu, Dan ^[1]; Konapala, Goutam ^[1]; Painter, Scott ^[1]; Kao, Shih-Chieh ^[1]; Gangrade, Sudershan ^[1]

---

1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

Hydrologic predictions at rural watersheds are important but also challenging due to data shortage. Long short-term memory (LSTM) networks are a promising machine learning approach and have demonstrated good performance in streamflow predictions. However, due to its data-hungry nature, most LSTM applications focus on well-monitored catchments with abundant and high-quality observations. In this work, we investigate predictive capabilities of LSTM in poorly monitored watersheds with short observation records. To address three main challenges of LSTM applications in data-scarce locations, i.e., overfitting, uncertainty quantification (UQ), and out-of-distribution prediction, we evaluate different regularization techniques to prevent overfitting, apply a Bayesian LSTM for UQ, and introduce a physics-informed hybrid LSTM to enhance out-of-distribution prediction. Through case studies in two diverse sets of catchments with and without snow influence, we demonstrate that 1) when hydrologic variability in the prediction period is similar to the calibration period, LSTM models can reasonably predict daily streamflow with Nash–Sutcliffe efficiency above 0.8, even with only 2 years of calibration data; 2) when the hydrologic variability in the prediction and calibration periods is dramatically different, LSTM alone does not predict well, but the hybrid model can improve the out-of-distribution prediction with acceptable generalization accuracy; 3) L2 norm penalty and dropout can mitigate overfitting, and Bayesian and hybrid LSTM have no overfitting; and 4) Bayesian LSTM provides useful uncertainty information to improve prediction understanding and credibility. In conclusion, these insights have vital implications for streamflow simulation in watersheds where data quality and availability are a critical issue.

• Research Organization: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
• Sponsoring Organization: USDOE Office of Science (SC), Biological and Environmental Research (BER)
• Grant/Contract Number: AC05-00OR22725
• OSTI ID: 1808403
• Journal Information: Journal of Hydrometeorology, Journal Name: Journal of Hydrometeorology Journal Issue: 6 Vol. 22; ISSN 1525-755X
• Publisher: American Meteorological Society
• Country of Publication: United States
• Language: English

Related Subjects

54 ENVIRONMENTAL SCIENCES