DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Bridging Hydrological Ensemble Simulation and Learning Using Deep Neural Operators

Journal Article · · Water Resources Research

Ensemble-based simulation and learning (ESnL) has long been used in hydrology for parameter inference, but computational demands of process-based ESnL can be quite high. To address this issue, we propose a deep neural operator learning approach. Neural operators are generic machine learning algorithms that can learn functional mappings between infinite-dimensional spaces, providing a highly flexible tool for scientific machine learning. Our approach is built upon DeepONet, a specific deep neural operator, and is designed to address several common problems in hydrology, namely, model parameter estimation, prediction at ungaged locations, and uncertainty quantification. Here we demonstrate the effectiveness of our DeepONet-based workflow using an existing large model ensemble created for an eastern U.S. watershed that is instrumented with 10 streamflow gages. Results suggest DeepONet achieves high efficiency in learning an ML surrogate model from the model ensemble, with the modified Kling-Gupta Efficiency exceeding 0.9 on holdout test sets. Parameter inference, carried out using the trained DeepONet surrogate model and genetic algorithm, also yields robust results. Additionally, we formulate and train a separate DeepONet model for physics-informed, seq-to-seq streamflow forecasting, which further reduces biases in the pre-trained DeepONet surrogate model. While this study focuses primarily on a single watershed, our approach is general and may be extended to enable learning from model ensembles across multiple basins or models. Thus, this research represents a significant contribution to the application of hybrid machine learning in hydrology.

Research Organization:
Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Biological and Environmental Research (BER). Earth & Environmental Systems Science (EESS); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
AC05-76RL01830; SC0022211
OSTI ID:
2475279
Report Number(s):
PNNL-SA--203681
Journal Information:
Water Resources Research, Journal Name: Water Resources Research Journal Issue: 10 Vol. 60; ISSN 0043-1397
Publisher:
American Geophysical Union (AGU)Copyright Statement
Country of Publication:
United States
Language:
English

References (39)

Application of ensemble-based data assimilation techniques for aquifer characterization using tracer data at Hanford 300 area: Tracer Data Assimilation at Hanford 300 Area journal October 2013
Relating hydrogeomorphic properties to stream buffering chemistry in the Neversink River watershed, New York State, USA journal December 2010
Ensemble learning: A survey journal February 2018
Model Calibration and Parameter Estimation book January 2015
The Ensemble Kalman Filter: theoretical formulation and practical implementation journal November 2003
Dual state–parameter estimation of hydrological models using ensemble Kalman filter journal February 2005
Multi-model ensemble hydrologic prediction using Bayesian model averaging journal May 2007
Hydrological data assimilation with the ensemble Kalman filter: Use of streamflow observations to update states in a distributed hydrological model journal October 2008
Coupling surface flow and subsurface flow in complex soil structures using mimetic finite differences journal October 2020
U-FNO—An enhanced Fourier neural operator-based deep-learning model for multiphase flow journal May 2022
A recommendation on standardized surface resistance for hourly calculation of reference ETo by the FAO56 Penman-Monteith method journal March 2006
Model Predictive Control of water resources systems: A review and research agenda journal January 2023
Changes in stream chemistry and biology in response to reduced levels of acid deposition during 1987–2003 in the Neversink River Basin, Catskill Mountains journal May 2008
Watershed Workflow: A toolset for parameterizing data-intensive, integrated hydrologic models journal November 2022
Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons journal March 2023
Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios journal March 2012
A hybrid approach to monthly streamflow forecasting: Integrating hydrological model outputs into a Bayesian artificial neural network journal September 2016
Ensemble machine learning paradigms in hydrology: A review journal July 2021
A robust deep learning workflow to predict multiphase flow behavior during geological CO2 sequestration injection and Post-Injection periods journal April 2022
Developing a cost-effective emulator for groundwater flow modeling using deep neural operators journal February 2024
Optimizing parameter learning and calibration in an integrated hydrological model: Impact of observation length and information journal November 2024
DeepONet-grid-UQ: A trustworthy deep operator framework for predicting the power grid’s post-fault trajectories journal May 2023
A survey on modern trainable activation functions journal June 2021
Treatment of uncertainty using ensemble methods: Comparison of sequential data assimilation and Bayesian model averaging: SEQUENTIAL DATA ASSIMILATION journal January 2007
Uncertainty in hydrologic modeling: Toward an integrated data assimilation framework: HYDROLOGIC DATA ASSIMILATION journal July 2007
Continental-scale water and energy flux analysis and validation for the North American Land Data Assimilation System project phase 2 (NLDAS-2): 1. Intercomparison and application of model products: WATER AND ENERGY FLUX ANALYSIS journal February 2012
A State‐of‐the‐Art Review of Optimal Reservoir Control for Managing Conflicting Demands in a Changing World journal December 2021
Efficient Super‐Resolution of Near‐Surface Climate Modeling Using the Fourier Neural Operator journal July 2023
Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information journal April 1998
The use of the multi-model ensemble in probabilistic climate projections
  • Tebaldi, Claudia; Knutti, Reto
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 365, Issue 1857 https://doi.org/10.1098/rsta.2007.2076
journal June 2007
Multifidelity deep neural operators for efficient learning of partial differential equations with application to fast inverse design of nanoscale heat transport journal June 2022
Deep Residual Learning for Image Recognition conference June 2016
Rapid Flood Inundation Forecast Using Fourier Neural Operator conference October 2023
Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems journal November 2022
Ensemble Data Assimilation without Perturbed Observations journal July 2002
The Community Earth System Model (CESM) Large Ensemble Project: A Community Resource for Studying Climate Change in the Presence of Internal Climate Variability journal August 2015
Strictly Proper Scoring Rules, Prediction, and Estimation journal March 2007
Information theory applied to evaluate the discharge monitoring network of the Magdalena River journal September 2012
Hydrostats: A Python Package for Characterizing Errors between Observed and Predicted Time Series journal December 2018