Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Scalable deep learning for watershed model calibration

Journal Article · · Frontiers in Earth Science
Watershed models such as the Soil and Water Assessment Tool (SWAT) consist of high-dimensional physical and empirical parameters. These parameters often need to be estimated/calibrated through inverse modeling to produce reliable predictions on hydrological fluxes and states. Existing parameter estimation methods can be time consuming, inefficient, and computationally expensive for high-dimensional problems. In this paper, we present an accurate and robust method to calibrate the SWAT model (i.e., 20 parameters) using scalable deep learning (DL). We developed inverse models based on convolutional neural networks (CNN) to assimilate observed streamflow data and estimate the SWAT model parameters. Scalable hyperparameter tuning is performed using high-performance computing resources to identify the top 50 optimal neural network architectures. We used ensemble SWAT simulations to train, validate, and test the CNN models. We estimated the parameters of the SWAT model using observed streamflow data and assessed the impact of measurement errors on SWAT model calibration. We tested and validated the proposed scalable DL methodology on the American River Watershed, located in the Pacific Northwest-based Yakima River basin. Our results show that the CNN-based calibration is better than two popular parameter estimation methods (i.e., the generalized likelihood uncertainty estimation [GLUE] and the dynamically dimensioned search [DDS], which is a global optimization algorithm). For the set of parameters that are sensitive to the observations, our proposed method yields narrower ranges than the GLUE method but broader ranges than values produced using the DDS method within the sampling range even under high relative observational errors. The SWAT model calibration performance using the CNNs, GLUE, and DDS methods are compared using R2 and a set of efficiency metrics, including Nash-Sutcliffe, logarithmic Nash-Sutcliffe, Kling-Gupta, modified Kling-Gupta, and non-parametric Kling-Gupta scores, computed on the observed and simulated watershed responses. The best CNN-based calibrated set has scores of 0.71, 0.75, 0.85, 0.85, 0.86, and 0.91. The best DDS-based calibrated set has scores of 0.62, 0.69, 0.8, 0.77, 0.79, and 0.82. The best GLUE-based calibrated set has scores of 0.56, 0.58, 0.71, 0.7, 0.71, and 0.8. The scores above show that the CNN-based calibration leads to more accurate low and high streamflow predictions than the GLUE and DDS sets. Our research demonstrates that the proposed method has high potential to improve our current practice in calibrating large-scale integrated hydrologic models.
Research Organization:
Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
Sponsoring Organization:
USDOE Office of Science (SC)
Grant/Contract Number:
AC05-76RL01830
OSTI ID:
1900374
Report Number(s):
PNNL-SA-176859
Journal Information:
Frontiers in Earth Science, Journal Name: Frontiers in Earth Science Vol. 10; ISSN 2296-6463
Publisher:
Frontiers Research FoundationCopyright Statement
Country of Publication:
United States
Language:
English

References (77)

Application of ensemble-based data assimilation techniques for aquifer characterization using tracer data at Hanford 300 area: Tracer Data Assimilation at Hanford 300 Area journal October 2013
Uncertainty in hydrological signatures for gauged and ungauged catchments journal March 2016
GLUE: 20 years on journal November 2013
Five guidelines for selecting hydrological signatures journal September 2017
Linking hydrologic signatures to hydrologic processes: A review journal January 2020
Automatic model calibration journal January 2005
Hydrologic prediction for urban watersheds with the Distributed Hydrology-Soil-Vegetation Model journal October 2008
Regionalization of hydrological modeling for predicting streamflow in ungauged catchments: A comprehensive review journal October 2020
A review of hydrologic signatures and their applications journal November 2020
Google Colaboratory book January 2019
The Ensemble Kalman Filter: theoretical formulation and practical implementation journal November 2003
Analysis of iterative ensemble smoothers for solving inverse problems journal March 2018
On Interface Conditions for Flows in Coupled Free-Porous Media journal August 2019
Optimal use of the SCE-UA global optimization method for calibrating watershed models journal June 1994
On the distribution of points in a cube and the approximate evaluation of integrals journal January 1967
Generalized likelihood uncertainty estimation (GLUE) using adaptive Markov Chain Monte Carlo sampling journal April 2008
Deep learning to estimate permeability using geophysical data journal September 2022
A parallelization framework for calibration of hydrological models journal May 2012
Moving SWAT model calibration and uncertainty analysis to an enterprise Hadoop-based cloud journal October 2016
Coupling surface flow with high-performance subsurface reactive flow and transport code PFLOTRAN journal March 2021
TOSSH: A Toolbox for Streamflow Signatures in Hydrology journal April 2021
DART-PFLOTRAN: An ensemble-based data assimilation system for estimating subsurface flow and transport model parameters journal August 2021
Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios journal March 2012
Modeling arid/semi-arid irrigated agricultural watersheds with SWAT: Applications, challenges, and solution strategies journal November 2020
A rational performance criterion for hydrological model journal November 2020
Deep learning in neural networks: An overview journal January 2015
Recent advances in convolutional neural networks journal May 2018
Dealing with Noise Problem in Machine Learning Data-sets: A Systematic Review journal January 2019
The Influence of Input Data Standardization Method on Prediction Accuracy of Artificial Neural Networks journal January 2016
Tutorial on maximum likelihood estimation journal February 2003
Bayesian recursive parameter estimation for hydrologic models journal October 2001
Dynamically dimensioned search algorithm for computationally efficient watershed model calibration: DYNAMICALLY DIMENSIONED SEARCH ALGORITHM journal January 2007
Generalized likelihood uncertainty estimation (GLUE) and approximate Bayesian computation: What's the connection? journal December 2012
A Transdisciplinary Review of Deep Learning Research and Its Relevance for Water Resources Scientists journal November 2018
Probing Slow Earthquakes With Deep Learning journal February 2020
Process‐Guided Deep Learning Predictions of Lake Water Temperature journal November 2019
What Role Does Hydrological Science Play in the Age of Machine Learning? journal March 2021
Using Mutual Information for Global Sensitivity Analysis on Watershed Modeling journal October 2022
Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics journal January 1994
Parameter optimization for watershed models journal June 1976
Sensitivity of optimized parameters in watershed models journal April 1978
From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling journal October 2021
The NHDPlus dataset, watershed subdivision and SWAT model performance journal August 2015
Evaluating model performance: towards a non-parametric variant of the Kling-Gupta efficiency journal October 2018
Exploring the exceptional performance of a deep learning stream temperature model and the value of streamflow data journal December 2020
SWAT model calibration over Cloud infrastructures using the BigEarth platform conference September 2017
Model-Agnostic Interpretability with Shapley Values conference July 2019
A Comprehensive Survey on Transfer Learning journal January 2021
The Road to NHDPlus - Advancements in Digital Stream Networks and Associated Catchments journal February 2016
Prospective Interest of Deep Learning for Hydrological Inference: J. Marçais and J.-R. de Dreuzy Groundwater xx, no. x: xx-xx journal July 2017
Approximating SWAT Model Using Artificial Neural Network and Support Vector Machine journal April 2009
Inverse Problem Theory and Methods for Model Parameter Estimation book January 2005
Deep learning hunts for signals among the noise journal May 2018
Physics-Guided Machine Learning for Scientific Discovery: An Application in Simulating Lake Temperature Profiles journal May 2021
RHESSys: Regional Hydro-Ecologic Simulation System—An Object-Oriented Approach to Spatially Distributed Modeling of Carbon, Water, and Nutrient Cycling journal December 2004
Data Assimilation and Inverse Methods in Terms of a Probabilistic Formulation journal December 1996
The Data Assimilation Research Testbed: A Community Facility journal September 2009
PERSIANN-CNN: Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks–Convolutional Neural Networks journal November 2019
Model Evaluation Guidelines for Systematic Quantification of Accuracy in Watershed Simulations journal January 2007
High-Quality Spatial Climate data sets for the United States and Beyond journal January 2000
Soil and Water Assessment Tool (SWAT) Model: Current Developments and Applications journal January 2010
SWAT: Model Use, Calibration, and Validation journal January 2012
Multi-variable SWAT model calibration with remotely sensed evapotranspiration and observed flow journal January 2017
SALib: An open-source Python library for Sensitivity Analysis journal January 2017
Deep learning convolutional neural network in rainfall–runoff modelling journal April 2020
Assessing watershed hydrological response to climate change based on signature indices journal April 2021
A comprehensive review of deep learning applications in hydrology and water resources journal August 2020
Watershed Modeling and its Applications: A State-of-the-Art Review journal April 2011
Estimating Watershed Subsurface Permeability From Stream Discharge Data Using Deep Neural Networks journal February 2021
Groundwater Estimation from Major Physical Hydrology Components Using Artificial Neural Networks and Deep Learning journal December 2019
A machine learning approach to emulation and biophysical parameter estimation with the Community Land Model, version 5 journal January 2020
The Variable Infiltration Capacity model version 5 (VIC-5): infrastructure improvements for new applications and reproducibility journal January 2018
A multirate mass transfer model to represent the interaction of multicomponent biogeochemical processes between surface water and hyporheic zones (SWAT-MRMT-R 1.0) journal January 2020
Uncertainty in hydrological signatures journal September 2015
Knowledge-Informed Deep Learning for Hydrological Model Calibration: An Application to Coal Creek Watershed in Colorado posted_content August 2022
Implications of water management representations for watershed hydrologic modeling in the Yakima River basin journal January 2019
Evaluating model performance: towards a non-parametric variant of the Kling-Gupta efficiency dataset January 2018

Similar Records

Analysis of alternative climate datasets and evapotranspiration methods for the Upper Mississippi River Basin using SWAT within HAWQS
Journal Article · Sat Jun 27 20:00:00 EDT 2020 · Science of the Total Environment · OSTI ID:1632817

Knowledge-informed deep learning for hydrological model calibration: an application to Coal Creek Watershed in Colorado
Journal Article · Tue Jul 18 20:00:00 EDT 2023 · Hydrology and Earth System Sciences (Online) · OSTI ID:1991443