Prolongation of SMAP to Spatiotemporally Seamless Coverage of Continental U.S. Using a Deep Learning Neural Network
Abstract
The Soil Moisture Active Passive (SMAP) mission has delivered valuable sensing of surface soil moisture since 2015. However, it has a short time span and irregular revisit schedules. Utilizing a state-of-the-art time series deep learning neural network, Long Short-Term Memory (LSTM), we created a system that predicts SMAP level-3 moisture product with atmospheric forcings, model-simulated moisture, and static physiographic attributes as inputs. The system removes most of the bias with model simulations and improves predicted moisture climatology, achieving small test root-mean-square errors (<0.035) and high-correlation coefficients >0.87 for over 75% of Continental United States, including the forested southeast. As the first application of LSTM in hydrology, we show the proposed network avoids overfitting and is robust for both temporal and spatial extrapolation tests. LSTM generalizes well across regions with distinct climates and environmental settings. With high fidelity to SMAP, LSTM shows great potential for hindcasting, data assimilation, and weather forecasting.
- Publication Date:
- Research Org.:
- Pennsylvania State Univ., University Park, PA (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC)
- OSTI Identifier:
- 1537301
- Grant/Contract Number:
- SC0010620
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Geophysical Research Letters
- Additional Journal Information:
- Journal Volume: 44; Journal Issue: 21; Journal ID: ISSN 0094-8276
- Publisher:
- American Geophysical Union
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 54 ENVIRONMENTAL SCIENCES; Geology
Citation Formats
Fang, Kuai, Shen, Chaopeng, Kifer, Daniel, and Yang, Xiao. Prolongation of SMAP to Spatiotemporally Seamless Coverage of Continental U.S. Using a Deep Learning Neural Network. United States: N. p., 2017.
Web. doi:10.1002/2017gl075619.
Fang, Kuai, Shen, Chaopeng, Kifer, Daniel, & Yang, Xiao. Prolongation of SMAP to Spatiotemporally Seamless Coverage of Continental U.S. Using a Deep Learning Neural Network. United States. https://doi.org/10.1002/2017gl075619
Fang, Kuai, Shen, Chaopeng, Kifer, Daniel, and Yang, Xiao. Mon .
"Prolongation of SMAP to Spatiotemporally Seamless Coverage of Continental U.S. Using a Deep Learning Neural Network". United States. https://doi.org/10.1002/2017gl075619. https://www.osti.gov/servlets/purl/1537301.
@article{osti_1537301,
title = {Prolongation of SMAP to Spatiotemporally Seamless Coverage of Continental U.S. Using a Deep Learning Neural Network},
author = {Fang, Kuai and Shen, Chaopeng and Kifer, Daniel and Yang, Xiao},
abstractNote = {The Soil Moisture Active Passive (SMAP) mission has delivered valuable sensing of surface soil moisture since 2015. However, it has a short time span and irregular revisit schedules. Utilizing a state-of-the-art time series deep learning neural network, Long Short-Term Memory (LSTM), we created a system that predicts SMAP level-3 moisture product with atmospheric forcings, model-simulated moisture, and static physiographic attributes as inputs. The system removes most of the bias with model simulations and improves predicted moisture climatology, achieving small test root-mean-square errors (<0.035) and high-correlation coefficients >0.87 for over 75% of Continental United States, including the forested southeast. As the first application of LSTM in hydrology, we show the proposed network avoids overfitting and is robust for both temporal and spatial extrapolation tests. LSTM generalizes well across regions with distinct climates and environmental settings. With high fidelity to SMAP, LSTM shows great potential for hindcasting, data assimilation, and weather forecasting.},
doi = {10.1002/2017gl075619},
journal = {Geophysical Research Letters},
number = 21,
volume = 44,
place = {United States},
year = {Mon Oct 16 00:00:00 EDT 2017},
month = {Mon Oct 16 00:00:00 EDT 2017}
}
Free Publicly Available Full Text
Publisher's Version of Record
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 119 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Implementation of Noah land surface model advances in the National Centers for Environmental Prediction operational mesoscale Eta model
journal, November 2003
- Ek, M. B.; Mitchell, K. E.; Lin, Y.
- Journal of Geophysical Research: Atmospheres, Vol. 108, Issue D22
The Soil Moisture Active Passive (SMAP) Mission
journal, May 2010
- Entekhabi, Dara; Njoku, Eni G.; O'Neill, Peggy E.
- Proceedings of the IEEE, Vol. 98, Issue 5
Evaluation of soil moisture in CMIP5 simulations over the contiguous United States using in situ and satellite observations
journal, January 2017
- Yuan, Shanshui; Quiring, Steven M.
- Hydrology and Earth System Sciences, Vol. 21, Issue 4
Regional Soil Moisture Biases and Their Influence on WRF Model Temperature Forecasts over the Intermountain West
journal, February 2016
- Massey, Jeffrey D.; Steenburgh, W. James; Knievel, Jason C.
- Weather and Forecasting, Vol. 31, Issue 1
Daily reservoir inflow forecasting using multiscale deep feature learning with hybrid models
journal, January 2016
- Bai, Yun; Chen, Zhiqiang; Xie, Jingjing
- Journal of Hydrology, Vol. 532
Deep learning
journal, May 2015
- LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey
- Nature, Vol. 521, Issue 7553
A Data-Driven Approach for Daily Real-Time Estimates and Forecasts of Near-Surface Soil Moisture
journal, March 2017
- Koster, Randal D.; Reichle, Rolf H.; Mahanama, Sarith P. P.
- Journal of Hydrometeorology, Vol. 18, Issue 3
Improving the representation of hydrologic processes in Earth System Models: REPRESENTING HYDROLOGIC PROCESSES IN EARTH SYSTEM MODELS
journal, August 2015
- Clark, Martyn P.; Fan, Ying; Lawrence, David M.
- Water Resources Research, Vol. 51, Issue 8
A catchment-based approach to modeling land surface processes in a general circulation model: 1. Model structure
journal, October 2000
- Koster, Randal D.; Suarez, Max J.; Ducharne, Agnès
- Journal of Geophysical Research: Atmospheres, Vol. 105, Issue D20
Validation of SMAP surface soil moisture products with core validation sites
journal, March 2017
- Colliander, A.; Jackson, T. J.; Bindlish, R.
- Remote Sensing of Environment, Vol. 191
Long Short-Term Memory
journal, November 1997
- Hochreiter, Sepp; Schmidhuber, Jürgen
- Neural Computation, Vol. 9, Issue 8
Flash flood warning based on rainfall thresholds and soil moisture conditions: An assessment for gauged and ungauged basins
journal, December 2008
- Norbiato, Daniele; Borga, Marco; Degli Esposti, Silvia
- Journal of Hydrology, Vol. 362, Issue 3-4
Regions of Strong Coupling Between Soil Moisture and Precipitation
journal, August 2004
- Koster, R. D.
- Science, Vol. 305, Issue 5687
The components of a ‘SVAT’ scheme and their effects on a GCM's hydrological cycle
journal, January 1994
- Koster, Randal D.; Suarez, Max J.
- Advances in Water Resources, Vol. 17, Issue 1-2
Development and evaluation of Soil Moisture Deficit Index (SMDI) and Evapotranspiration Deficit Index (ETDI) for agricultural drought monitoring
journal, November 2005
- Narasimhan, B.; Srinivasan, R.
- Agricultural and Forest Meteorology, Vol. 133, Issue 1-4
Analysis of soil moisture memory from observations in Europe: SOIL MOISTURE MEMORY IN OBSERVATIONS
journal, August 2012
- Orth, R.; Seneviratne, S. I.
- Journal of Geophysical Research: Atmospheres, Vol. 117, Issue D15
Full-flow-regime storage-streamflow correlation patterns provide insights into hydrologic functioning over the continental US: STORAGE-STREAMFLOW CORRELATION SPECTRUM
journal, September 2017
- Fang, Kuai; Shen, Chaopeng
- Water Resources Research, Vol. 53, Issue 9
Improving Budyko curve-based estimates of long-term water partitioning using hydrologic signatures from GRACE: PREDICTING DEPARTURE FROM BUDYKO USING GRACE
journal, July 2016
- Fang, Kuai; Shen, Chaopeng; Fisher, Joshua B.
- Water Resources Research, Vol. 52, Issue 7
An Evaluation of the North American Regional Reanalysis Simulated Soil Moisture Conditions during the 2011–13 Drought Period
journal, February 2017
- Leeper, Ronald D.; Bell, Jesse E.; Vines, Chanté
- Journal of Hydrometeorology, Vol. 18, Issue 2
Confronting Weather and Climate Models with Observational Data from Soil Moisture Networks over the United States
journal, April 2016
- Dirmeyer, Paul A.; Wu, Jiexia; Norton, Holly E.
- Journal of Hydrometeorology, Vol. 17, Issue 4
Flash flood warning based on rainfall thresholds and soil moisture conditions: An assessment for gauged and ungauged basins
journal, December 2008
- Norbiato, Daniele; Borga, Marco; Degli Esposti, Silvia
- Journal of Hydrology, Vol. 362, Issue 3-4
Global Retrospective Estimation of Soil Moisture Using the Variable Infiltration Capacity Land Surface Model, 1980–93
journal, April 2001
- Nijssen, Bart; Schnur, Reiner; Lettenmaier, Dennis P.
- Journal of Climate, Vol. 14, Issue 8
Comparison of NLDAS-2 Simulated and NASMD Observed Daily Soil Moisture. Part I: Comparison and Analysis
journal, October 2015
- Xia, Youlong; Ek, Michael B.; Wu, Yihua
- Journal of Hydrometeorology, Vol. 16, Issue 5
Recurrent Dropout without Memory Loss
preprint, January 2016
- Semeniuta, Stanislau; Severyn, Aliaksei; Barth, Erhardt
- arXiv
Evaluation of soil moisture in CMIP5 simulations over the contiguous United States using in situ and satellite observations
journal, January 2017
- Yuan, Shanshui; Quiring, Steven M.
- Hydrology and Earth System Sciences, Vol. 21, Issue 4
Works referencing / citing this record:
Long short-term memory (LSTM) recurrent neural network for low-flow hydrological time series forecasting
journal, July 2019
- Sahoo, Bibhuti Bhusan; Jha, Ramakar; Singh, Anshuman
- Acta Geophysica, Vol. 67, Issue 5
Discovering State‐Parameter Mappings in Subsurface Models Using Generative Adversarial Networks
journal, October 2018
- Sun, Alexander Y.
- Geophysical Research Letters, Vol. 45, Issue 20
Combining Physically Based Modeling and Deep Learning for Fusing GRACE Satellite Data: Can We Learn From Mismatch?
journal, February 2019
- Sun, Alexander Y.; Scanlon, Bridget R.; Zhang, Zizhan
- Water Resources Research, Vol. 55, Issue 2
Exploring Deep Neural Networks to Retrieve Rain and Snow in High Latitudes Using Multisensor and Reanalysis Data
journal, October 2018
- Tang, Guoqiang; Long, Di; Behrangi, Ali
- Water Resources Research, Vol. 54, Issue 10
Insights Into Preferential Flow Snowpack Runoff Using Random Forest
journal, December 2019
- Avanzi, Francesco; Johnson, Ryan Curtis; Oroza, Carlos A.
- Water Resources Research, Vol. 55, Issue 12
Gap Filling of High‐Resolution Soil Moisture for SMAP/Sentinel‐1: A Two‐Layer Machine Learning‐Based Framework
journal, August 2019
- Mao, Hanzi; Kathuria, Dhruva; Duffield, Nick
- Water Resources Research, Vol. 55, Issue 8
Process‐Guided Deep Learning Predictions of Lake Water Temperature
journal, November 2019
- Read, Jordan S.; Jia, Xiaowei; Willard, Jared
- Water Resources Research, Vol. 55, Issue 11
Machine Learning in Agriculture: A Review
journal, August 2018
- Liakos, Konstantinos; Busato, Patrizia; Moshou, Dimitrios
- Sensors, Vol. 18, Issue 8
Hydrological Early Warning System Based on a Deep Learning Runoff Model Coupled with a Meteorological Forecast
journal, August 2019
- de la Fuente, Alberto; Meruane, Viviana; Meruane, Carolina
- Water, Vol. 11, Issue 9
Comparison of Long Short Term Memory Networks and the Hydrological Model in Runoff Simulation
journal, January 2020
- Fan, Hongxiang; Jiang, Mingliang; Xu, Ligang
- Water, Vol. 12, Issue 1
Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks
journal, January 2018
- Kratzert, Frederik; Klotz, Daniel; Brenner, Claire
- Hydrology and Earth System Sciences, Vol. 22, Issue 11
Machine Learning in Agriculture: A Review
journal, August 2018
- Liakos, Konstantinos; Busato, Patrizia; Moshou, Dimitrios
- Sensors, Vol. 18, Issue 8