DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: HESS Opinions: Incubating deep-learning-powered hydrologic science advances as a community

Journal Article · · Hydrology and Earth System Sciences (Online)
 [1];  [2]; ORCiD logo [3];  [4]; ORCiD logo [5];  [6];  [7];  [8];  [1]; ORCiD logo [9];  [1];  [9];  [10];  [1]
  1. Pennsylvania State Univ., University Park, PA (United States)
  2. Belgian Nuclear Research Centre, Mol (Belgium)
  3. Univ. of Saskatchewan, Saskatoon, SK (Canada)
  4. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
  5. Consortium of Univ. for the Advancement of Hydrologic Science, Inc. (CUAHSI), Cambridge, MA (United States)
  6. National Taiwan Univ., Taipei (Taiwan)
  7. NASA Ames Research Center (ARC), Moffett Field, Mountain View, CA (United States)
  8. Univ. of California, Irvine, CA (United States)
  9. Univ. of Texas, Arlington, TX (United States)
  10. Sichuan Univ., Sichuan (China)

Recently, deep learning (DL) has emerged as a revolutionary and versatile tool transforming industry applications and generating new and improved capabilities for scientific discovery and model building. The adoption of DL in hydrology has so far been gradual, but the field is now ripe for breakthroughs. This paper suggests that DL-based methods can open up a complementary avenue toward knowledge discovery in hydrologic sciences. In the new avenue, machine-learning algorithms present competing hypotheses that are consistent with data. Interrogative methods are then invoked to interpret DL models for scientists to further evaluate. However, hydrology presents many challenges for DL methods, such as data limitations, heterogeneity and co-evolution, and the general inexperience of the hydrologic field with DL. The roadmap toward DL-powered scientific advances will require the coordinated effort from a large community involving scientists and citizens.Integrating process-based models with DL models will help alleviate data limitations. The sharing of data and baseline models will improve the efficiency of the community as a whole. Open competitions could serve as the organizing events to greatly propel growth and nurture data science education in hydrology, which demands a grassroots collaboration. The area of hydrologic DL presents numerous research opportunities that could, in turn,stimulate advances in machine learning as well.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC); National Science Foundation (NSF)
Grant/Contract Number:
AC02-05CH11231; SC0016605
OSTI ID:
1542338
Journal Information:
Hydrology and Earth System Sciences (Online), Journal Name: Hydrology and Earth System Sciences (Online) Journal Issue: 11 Vol. 22; ISSN 1607-7938
Publisher:
European Geosciences Union (EGU)Copyright Statement
Country of Publication:
United States
Language:
English

References (108)

Soil–landscape modeling across a physiographic region: Topographic patterns and model transportability journal July 2006
Changing ideas in hydrology — The case of physically-based models journal January 1989
The AI detectives journal July 2017
Accelerating advances in continental domain hydrologic modeling: ACCELERATING ADVANCES IN CONTINENTAL HYDROLOGIC MODELING journal December 2015
Full-flow-regime storage-streamflow correlation patterns provide insights into hydrologic functioning over the continental US: STORAGE-STREAMFLOW CORRELATION SPECTRUM journal September 2017
It takes a community to raise a hydrologist: the Modular Curriculum for Hydrologic Advancement (MOCHA) journal January 2012
Development of a computationally efficient semi-distributed hydrologic modeling application for soil moisture, lateral flow and runoff simulation journal November 2016
Self-organizing linear output map (SOLO): An artificial neural network suitable for hydrologic modeling and analysis: SOLO, AN ANN MODEL SUITABLE FOR HYDROLOGIC MODELING journal December 2002
Time-variable gravity from GRACE: First results: TIME-VARIABLE GRAVITY FROM GRACE journal June 2004
A Deep Neural Network Modeling Framework to Reduce Bias in Satellite Precipitation Products journal March 2016
Creativity, Uncertainty, and Automated Model Building: Technical Commentary journal July 2017
Long Short-Term Memory journal November 1997
Deep learning for computational chemistry journal March 2017
Regional flood inundation nowcast using hybrid SOM and dynamic neural networks journal November 2014
Toward the camera rain gauge journal March 2015
Speech recognition with deep recurrent neural networks conference May 2013
Fusing Heterogeneous Data: A Case for Remote Sensing and Social Media journal December 2018
The Soil Moisture and Ocean Salinity Mission - An Overview conference July 2008
Parallel Multi-Dimensional LSTM, With Application to Fast Biomedical Volumetric Image Segmentation preprint January 2015
Data-driven modelling approaches for socio-hydrology: opportunities and challenges within the Panta Rhei Science Plan journal April 2016
Anatomy of an Enduring Gender Gap: The Evolution of Women’s Participation in Computer Science journal December 2016
A decade of Predictions in Ungauged Basins (PUB)—a review journal June 2013
The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions journal April 1998
Reconstruction of three-dimensional porous media using generative adversarial neural networks journal October 2017
Methods used for the development of neural networks for the prediction of water resource variables in river systems: Current status and future directions journal August 2010
Artificial Neural Networks in Hydrology. II: Hydrologic Applications journal April 2000
Improvements to a MODIS global terrestrial evapotranspiration algorithm journal August 2011
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification dataset January 2018
Accuracy of GRACE mass estimates journal January 2006
Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasets preprint January 2016
Systematic Bias in Land Surface Models journal October 2007
The German Traffic Sign Recognition Benchmark: A multi-class classification competition
  • Stallkamp, Johannes; Schlipsing, Marc; Salmen, Jan
  • 2011 International Joint Conference on Neural Networks (IJCNN 2011 - San Jose), The 2011 International Joint Conference on Neural Networks https://doi.org/10.1109/IJCNN.2011.6033395
conference July 2011
Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data journal October 2017
The future of hydrology: An evolving science for a changing world: OPINION journal May 2010
Deep learning for computational biology journal July 2016
Inversion using a new low-dimensional representation of complex binary geological media based on a deep neural network journal December 2017
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources journal December 2017
Changing ideas in hydrology — The case of physically-based models journal January 1989
Image Style Transfer Using Convolutional Neural Networks conference June 2016
Understanding deep image representations by inverting them conference June 2015
Regression Shrinkage and Selection Via the Lasso journal January 1996
A Closer Look at Memorization in Deep Networks preprint January 2017
HydroShare: Sharing Diverse Environmental Data Types and Models as Social Objects with Application to the Hydrology Domain journal October 2015
“Panta Rhei—Everything Flows”: Change in hydrology and society—The IAHS Scientific Decade 2013–2022 journal July 2013
Global patterns of drought recovery journal August 2017
Mode Detection in Online Handwritten Documents Using BLSTM Neural Networks conference September 2012
A Big Data Guide to Understanding Climate Change: The Case for Theory-Guided Data Science journal September 2014
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification dataset January 2018
Moving university hydrology education forward with community-based geoinformatics, data and modeling resources journal January 2012
Anticipating Visual Representations from Unlabeled Video conference June 2016
Deep learning for computational chemistry journal March 2017
Deep Residual Learning for Image Recognition conference June 2016
Deriving global parameter estimates for the Noah land surface model using FLUXNET and machine learning: Improving Noah LSM Parameters journal November 2016
FloodEye: Real-time flash flood prediction system for urban complex water flow conference October 2016
Predicting non-small cell lung cancer prognosis by fully automated microscopic pathology image features journal August 2016
Systematic Bias in Land Surface Models journal October 2007
Methods of the Water-Energy-Food Nexus journal October 2015
Neural Error Regression Diagnosis (NERD): A Tool for Model Bias Identification and Prognostic Data Assimilation journal February 2006
DeepSD: Generating High Resolution Climate Change Projections through Single Image Super-Resolution
  • Vandal, Thomas; Kodra, Evan; Ganguly, Sangram
  • Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD '17 https://doi.org/10.1145/3097983.3098004
conference January 2017
Deep learning journal May 2015
Hydrologic synthesis: Across processes, places, and scales: HYDROLOGIC SYNTHESIS journal February 2006
Reconstruction of three-dimensional porous media using generative adversarial neural networks journal October 2017
Predictor-weighting strategies for probabilistic wind power forecasting with an analog ensemble [Predictor-weighting strategies for probabilistic wind power forecasting with an analog ensemble] journal July 2015
Detecting Arbitrary Oriented Text in the Wild with a Visual Attention Model conference January 2016
Hydrologic synthesis: Across processes, places, and scales: HYDROLOGIC SYNTHESIS journal February 2006
Deep learning for visual understanding: A review journal April 2016
The German Traffic Sign Recognition Benchmark: A multi-class classification competition
  • Stallkamp, Johannes; Schlipsing, Marc; Salmen, Jan
  • 2011 International Joint Conference on Neural Networks (IJCNN 2011 - San Jose), The 2011 International Joint Conference on Neural Networks https://doi.org/10.1109/ijcnn.2011.6033395
conference July 2011
A decade of Predictions in Ungauged Basins (PUB)—a review journal June 2013
Rainfall-Runoff modelling using Long-Short-Term-Memory (LSTM) networks text January 2018
Artificial Neural Network Modeling of the Rainfall-Runoff Process journal October 1995
Unidirectional long short-term memory recurrent neural network with recurrent output layer for low-latency speech synthesis conference April 2015
Deep Classifiers from Image Tags in the Wild
  • Izadinia, Hamid; Russell, Bryan C.; Farhadi, Ali
  • Proceedings of the 2015 Workshop on Community-Organized Multimodal Mining: Opportunities for Novel Solutions - MMCommons'15 https://doi.org/10.1145/2814815.2814821
conference January 2015
DeepQA Jeopardy! Gamification: A Machine-Learning Perspective journal March 2014
rosetta : a computer program for estimating soil hydraulic parameters with hierarchical pedotransfer functions journal October 2001
Prolongation of SMAP to Spatiotemporally Seamless Coverage of Continental U.S. Using a Deep Learning Neural Network journal November 2017
A unified approach for process‐based hydrologic modeling: 1. Modeling concept journal April 2015
Climate-vegetation-soil interactions and long-term hydrologic partitioning: signatures of catchment co-evolution journal January 2013
Active Learning journal June 2012
TOPMODEL: A critique journal July 1997
Evaluating the Visualization of What a Deep Neural Network Has Learned journal November 2017
Improved streamflow forecasting using self-organizing radial basis function artificial neural networks journal August 2004
Use long short-term memory to enhance Internet of Things for combined sewer overflow monitoring journal January 2018
Visualizing and Understanding Recurrent Networks preprint January 2015
A Two-Stage Deep Neural Network Framework for Precipitation Estimation from Bispectral Satellite Information journal February 2018
Vector-based navigation using grid-like representations in artificial agents journal May 2018
Kalman Filter and Analog Schemes to Postprocess Numerical Weather Predictions journal November 2011
Mode Detection in Online Handwritten Documents Using BLSTM Neural Networks conference September 2012
Advances in natural language processing journal July 2015
Benchmarking NLDAS-2 Soil Moisture and Evapotranspiration to Separate Uncertainty Contributions journal March 2016
Precipitation Identification with Bispectral Satellite Information Using Deep Learning Approaches journal May 2017
The AI detectives journal July 2017
Probabilistic Weather Prediction with an Analog Ensemble journal October 2013
Training‐Image Based Geostatistical Inversion Using a Spatial Generative Adversarial Neural Network journal January 2018
Modeling Urbanization Patterns with Generative Adversarial Networks conference July 2018
The Soil Moisture Active Passive (SMAP) Mission journal May 2010
Could Machine Learning Break the Convection Parameterization Deadlock? journal June 2018
TOPMODEL: A critique journal July 1997
Enhanced Higgs Boson to τ + τ − Search with Deep Learning journal March 2015
Going deeper with convolutions conference June 2015
A Transdisciplinary Review of Deep Learning Research and Its Relevance for Water Resources Scientists journal November 2018
Exploring the spatio-temporal interrelation between groundwater and surface water by using the self-organizing maps journal January 2018
The future of Earth observation in hydrology journal January 2017
Assessing the potential global extent of SWOT river discharge observations journal November 2014
Toward the camera rain gauge journal March 2015
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification dataset January 2018
A glimpse beneath earth's surface: GLobal HYdrogeology MaPS (GLHYMPS) of permeability and porosity journal June 2014
Deep learning in neural networks: An overview journal January 2015
Modeling urban coastal flood severity from crowd-sourced flood reports using Poisson regression and Random Forest journal April 2018

Cited By (17)

Hydrological Early Warning System Based on a Deep Learning Runoff Model Coupled with a Meteorological Forecast journal August 2019
An improved long short-term memory network for streamflow forecasting in the upper Yangtze River journal February 2020
Modelling of the shallow water table at high spatial resolution using random forests journal January 2019
Deep autoregressive neural networks for high-dimensional inverse problems in groundwater contaminant source identification text January 2018
Improving Precipitation Estimation Using Convolutional Neural Network text January 2018
Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks journal January 2018
Deep Autoregressive Neural Networks for High‐Dimensional Inverse Problems in Groundwater Contaminant Source Identification journal May 2019
Using Machine Learning for Prediction of Saturated Hydraulic Conductivity and Its Sensitivity to Soil Structural Perturbations journal July 2019
Deep Autoregressive Neural Networks for High‐Dimensional Inverse Problems in Groundwater Contaminant Source Identification journal May 2019
Deep autoregressive neural networks for high-dimensional inverse problems in groundwater contaminant source identification text January 2018
Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks journal January 2018
Modelling of the shallow water table at high spatial resolution using random forests journal January 2019
Advances in the Remote Sensing of Terrestrial Evaporation journal May 2019
Process‐Guided Deep Learning Predictions of Lake Water Temperature journal November 2019
A Review on Snowmelt Models: Progress and Prospect journal October 2021
Improving Precipitation Estimation Using Convolutional Neural Network journal March 2019
Velocity Field Estimation on Density‐Driven Solute Transport With a Convolutional Neural Network journal August 2019