Short-Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks
Abstract
Short-term Quantitative Precipitation Forecasting is important for flood forecasting, early flood warning, and natural hazard management. This study proposes a precipitation forecast model by extrapolating Cloud-Top Brightness Temperature (CTBT) using advanced Deep Neural Networks, and applying the forecasted CTBT into an effective rainfall retrieval algorithm to obtain the Short-term Quantitative Precipitation Forecasting (0–6 hr). To achieve such tasks, we propose a Long Short-Term Memory (LSTM) and the Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN), respectively. The precipitation forecasts obtained from our proposed framework, (i.e., LSTM combined with PERSIANN) are compared with a Recurrent Neural Network (RNN), Persistency method, and Farneback optical flow each combined with PERSIANN algorithm and the numerical model results from the first version of Rapid Refresh (RAPv1.0) over three regions in the United States, including the states of Oregon, Oklahoma, and Florida. We report our experiments indicate better statistics, such as correlation coefficient and root-mean-square error, for the CTBT forecasts from the proposed LSTM compared to the RNN, Persistency, and the Farneback method. The precipitation forecasts from the proposed LSTM and PERSIANN framework has demonstrated better statistics compared to the RAPv1.0 numerical forecasts and PERSIANN estimations from RNN, Persistency, and Farneback projections inmore »
- Authors:
-
- Univ. of California, Irvine, CA (United States)
- Univ. of California, Irvine, CA (United States); Univ. of Oklahoma, Norman, OK (United States)
- Univ. of California, Irvine, CA (United States); National Taiwan Ocean Univ., Keelung (Taiwan)
- China Inst. of Water Resources and Hydropower Research, Beijing (China)
- Publication Date:
- Research Org.:
- Univ. of California, Oakland, CA (United States)
- Sponsoring Org.:
- USDOE Office of International Affairs (IA); California Energy Commission; National Science Foundation (NSF); National Oceanic and Atmospheric Administration (NOAA); National Environmental Satellite, Data, and Information Service (NESDIS); National Climatic Data Center (NCDC); US Army Research Office (ARO)
- OSTI Identifier:
- 1613787
- Alternate Identifier(s):
- OSTI ID: 1482741
- Grant/Contract Number:
- IA0000018; 300-15-005; CCF-1331915; NA09NES4400006; NCSU CICS; W911NF-11-1-0422
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Geophysical Research: Atmospheres
- Additional Journal Information:
- Journal Volume: 123; Journal Issue: 22; Journal ID: ISSN 2169-897X
- Publisher:
- American Geophysical Union
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 54 ENVIRONMENTAL SCIENCES; 37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY; meteorology & atmospheric sciences; deep learning; LSTM; RNN; PERSIANN system; precipitation forecast; Rapid Refresh
Citation Formats
Akbari Asanjan, Ata, Yang, Tiantian, Hsu, Kuolin, Sorooshian, Soroosh, Lin, Junqiang, and Peng, Qidong. Short-Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks. United States: N. p., 2018.
Web. doi:10.1029/2018jd028375.
Akbari Asanjan, Ata, Yang, Tiantian, Hsu, Kuolin, Sorooshian, Soroosh, Lin, Junqiang, & Peng, Qidong. Short-Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks. United States. https://doi.org/10.1029/2018jd028375
Akbari Asanjan, Ata, Yang, Tiantian, Hsu, Kuolin, Sorooshian, Soroosh, Lin, Junqiang, and Peng, Qidong. Mon .
"Short-Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks". United States. https://doi.org/10.1029/2018jd028375. https://www.osti.gov/servlets/purl/1613787.
@article{osti_1613787,
title = {Short-Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks},
author = {Akbari Asanjan, Ata and Yang, Tiantian and Hsu, Kuolin and Sorooshian, Soroosh and Lin, Junqiang and Peng, Qidong},
abstractNote = {Short-term Quantitative Precipitation Forecasting is important for flood forecasting, early flood warning, and natural hazard management. This study proposes a precipitation forecast model by extrapolating Cloud-Top Brightness Temperature (CTBT) using advanced Deep Neural Networks, and applying the forecasted CTBT into an effective rainfall retrieval algorithm to obtain the Short-term Quantitative Precipitation Forecasting (0–6 hr). To achieve such tasks, we propose a Long Short-Term Memory (LSTM) and the Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN), respectively. The precipitation forecasts obtained from our proposed framework, (i.e., LSTM combined with PERSIANN) are compared with a Recurrent Neural Network (RNN), Persistency method, and Farneback optical flow each combined with PERSIANN algorithm and the numerical model results from the first version of Rapid Refresh (RAPv1.0) over three regions in the United States, including the states of Oregon, Oklahoma, and Florida. We report our experiments indicate better statistics, such as correlation coefficient and root-mean-square error, for the CTBT forecasts from the proposed LSTM compared to the RNN, Persistency, and the Farneback method. The precipitation forecasts from the proposed LSTM and PERSIANN framework has demonstrated better statistics compared to the RAPv1.0 numerical forecasts and PERSIANN estimations from RNN, Persistency, and Farneback projections in terms of Probability of Detection, False Alarm Ratio, Critical Success Index, correlation coefficient, and root-mean-square error, especially in predicting the convective rainfalls. The proposed method shows superior capabilities in short-term forecasting over compared methods, and has the potential to be implemented globally as an alternative short-term forecast product.},
doi = {10.1029/2018jd028375},
journal = {Journal of Geophysical Research: Atmospheres},
number = 22,
volume = 123,
place = {United States},
year = {Mon Oct 29 00:00:00 EDT 2018},
month = {Mon Oct 29 00:00:00 EDT 2018}
}
Web of Science
Works referenced in this record:
Comparison of PERSIANN and V7 TRMM Multi-satellite Precipitation Analysis (TMPA) products with rain gauge data over Iran
journal, September 2013
- Moazami, Saber; Golian, Saeed; Kavianpour, M. Reza
- International Journal of Remote Sensing, Vol. 34, Issue 22
Recurrent neural networks and robust time series prediction
journal, March 1994
- Connor, J. T.; Martin, R. D.; Atlas, L. E.
- IEEE Transactions on Neural Networks, Vol. 5, Issue 2
Short-term flood inundation prediction using hydrologic-hydraulic models forced with downscaled rainfall from global NWP: SHORT-TERM FLOOD INUNDATION PREDICTION
journal, October 2013
- Nam, Do Hoai; Mai, Dang Thanh; Udo, Keiko
- Hydrological Processes, Vol. 28, Issue 24
Developing reservoir monthly inflow forecasts using artificial intelligence and climate phenomenon information: RESERVOIR INFLOW FORECASTS
journal, April 2017
- Yang, Tiantian; Asanjan, Ata Akbari; Welles, Edwin
- Water Resources Research, Vol. 53, Issue 4
National Mosaic and Multi-Sensor QPE (NMQ) System: Description, Results, and Future Plans
journal, October 2011
- Zhang, Jian; Howard, Kenneth; Langston, Carrie
- Bulletin of the American Meteorological Society, Vol. 92, Issue 10
Diurnal Variations in Precipitation and Thunderstorm Frequency over the Conterminous United States
journal, May 1975
- Wallace, J. M.
- Monthly Weather Review, Vol. 103, Issue 5
An enhanced artificial neural network with a shuffled complex evolutionary global optimization with principal component analysis
journal, December 2017
- Yang, Tiantian; Asanjan, Ata Akabri; Faridzad, Mohammad
- Information Sciences, Vol. 418-419
A Microwave Infrared Threshold Technique to Improve the GOES Precipitation Index
journal, May 1999
- Xu, Liming; Gao, Xiaogang; Sorooshian, Soroosh
- Journal of Applied Meteorology, Vol. 38, Issue 5
Use of NWP for Nowcasting Convective Precipitation: Recent Progress and Challenges
journal, March 2014
- Sun, Juanzhen; Xue, Ming; Wilson, James W.
- Bulletin of the American Meteorological Society, Vol. 95, Issue 3
Self-organized formation of topologically correct feature maps
journal, January 1982
- Kohonen, Teuvo
- Biological Cybernetics, Vol. 43, Issue 1
Evaluation of a new satellite-based precipitation data set for climate studies in the Xiang River basin, southern China: EVALUATION OF PERSIANN-CDR FOR CLIMATE STUDIES
journal, May 2017
- Zhu, Qian; Hsu, Kuo-lin; Xu, Yue-Ping
- International Journal of Climatology, Vol. 37, Issue 13
LSTM: A Search Space Odyssey
journal, October 2017
- Greff, Klaus; Srivastava, Rupesh K.; Koutnik, Jan
- IEEE Transactions on Neural Networks and Learning Systems, Vol. 28, Issue 10
Evaluation of numerical weather prediction model precipitation forecasts for short-term streamflow forecasting purpose
journal, January 2013
- Shrestha, D. L.; Robertson, D. E.; Wang, Q. J.
- Hydrology and Earth System Sciences, Vol. 17, Issue 5
Distributed Quantitative Precipitation Forecasting Using Information from Radar and Numerical Weather Prediction Models
journal, December 2003
- Ganguly, Auroop R.; Bras, Rafael L.
- Journal of Hydrometeorology, Vol. 4, Issue 6
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
conference, January 2014
- Cho, Kyunghyun; van Merrienboer, Bart; Gulcehre, Caglar
- Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Rainfall forecasting in space and time using a neural network
journal, August 1992
- French, Mark N.; Krajewski, Witold F.; Cuykendall, Robert R.
- Journal of Hydrology, Vol. 137, Issue 1-4
Nimrod: A system for generating automated very short range forecasts
journal, March 1998
- Golding, B. W.
- Meteorological Applications, Vol. 5, Issue 1
Generalization of backpropagation with application to a recurrent gas market model
journal, January 1988
- Werbos, Paul J.
- Neural Networks, Vol. 1, Issue 4
Evaluating the streamflow simulation capability of PERSIANN-CDR daily rainfall products in two river basins on the Tibetan Plateau
journal, January 2017
- Liu, Xiaomang; Yang, Tiantian; Hsu, Koulin
- Hydrology and Earth System Sciences, Vol. 21, Issue 1
Framewise phoneme classification with bidirectional LSTM and other neural network architectures
journal, July 2005
- Graves, Alex; Schmidhuber, Jürgen
- Neural Networks, Vol. 18, Issue 5-6
Precipitation Forecasting Using a Neural Network
journal, June 1999
- Hall, Tony; Brooks, Harold E.; Doswell, Charles A.
- Weather and Forecasting, Vol. 14, Issue 3
Experiments in Short-Term Precipitation Forecasting Using Artificial Neural Networks
journal, February 1998
- Kuligowski, Robert J.; Barros, Ana P.
- Monthly Weather Review, Vol. 126, Issue 2
Post-processing rainfall forecasts from numerical weather prediction models for short-term streamflow forecasting
journal, January 2013
- Robertson, D. E.; Shrestha, D. L.; Wang, Q. J.
- Hydrology and Earth System Sciences, Vol. 17, Issue 9
Localized Precipitation Forecasts from a Numerical Weather Prediction Model Using Artificial Neural Networks
journal, December 1998
- Kuligowski, Robert J.; Barros, Ana P.
- Weather and Forecasting, Vol. 13, Issue 4
Scene labeling with LSTM recurrent neural networks
conference, June 2015
- Byeon, Wonmin; Breuel, Thomas M.; Raue, Federico
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Long Short-Term Memory
journal, November 1997
- Hochreiter, Sepp; Schmidhuber, Jürgen
- Neural Computation, Vol. 9, Issue 8
Performance of 4D-Var NWP-based nowcasting of precipitation at the Met Office for summer 2012: 4D-Var NWP-based Nowcasting of Precipitation
journal, November 2015
- Ballard, Susan P.; Li, Zhihong; Simonin, David
- Quarterly Journal of the Royal Meteorological Society, Vol. 142, Issue 694
The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions
journal, April 1998
- Hochreiter, Sepp
- International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, Vol. 06, Issue 02
Consensus Clustering of U.S. Temperature and Precipitation Data
journal, June 1997
- Fovell, Robert G.
- Journal of Climate, Vol. 10, Issue 6
A Comprehensive Radiation Scheme for Numerical Weather Prediction Models with Potential Applications in Climate Simulations
journal, February 1992
- Ritter, Bodo; Geleyn, Jean-Francois
- Monthly Weather Review, Vol. 120, Issue 2
Evaluation of satellite-based precipitation estimation over Iran
journal, October 2013
- Katiraie-Boroujerdy, Pari-Sima; Nasrollahi, Nasrin; Hsu, Kuo-lin
- Journal of Arid Environments, Vol. 97
The estimation of global monthly mean rainfall using infrared satellite data: The GOES precipitation index (GPI)
journal, October 1994
- Arkin, Phillip A.; Joyce, Robert; Janowiak, John E.
- Remote Sensing Reviews, Vol. 11, Issue 1-4
Development and verification of a real-time stochastic precipitation nowcasting system for urban hydrology in Belgium
journal, January 2016
- Foresti, L.; Reyniers, M.; Seed, A.
- Hydrology and Earth System Sciences, Vol. 20, Issue 1
Self-organizing linear output map (SOLO): An artificial neural network suitable for hydrologic modeling and analysis: SOLO, AN ANN MODEL SUITABLE FOR HYDROLOGIC MODELING
journal, December 2002
- Hsu, Kuo-lin; Gupta, Hoshin V.; Gao, Xiaogang
- Water Resources Research, Vol. 38, Issue 12
Improving QPE and Very Short Term QPF: An Initiative for a Community-Wide Integrated Approach
journal, December 2007
- Vasiloff, Steven V.; Seo, Dong-Jun; Howard, Kenneth W.
- Bulletin of the American Meteorological Society, Vol. 88, Issue 12
Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks
journal, September 1997
- Hsu, Kou-lin; Gao, Xiaogang; Sorooshian, Soroosh
- Journal of Applied Meteorology, Vol. 36, Issue 9
An Automated Technique to Quality Control Radar Reflectivity Data
journal, March 2007
- Lakshmanan, Valliappa; Fritz, Angela; Smith, Travis
- Journal of Applied Meteorology and Climatology, Vol. 46, Issue 3
PERSIANN-MSA: A Precipitation Estimation Method from Satellite-Based Multispectral Analysis
journal, December 2009
- Behrangi, Ali; Hsu, Kuo-lin; Imam, Bisher
- Journal of Hydrometeorology, Vol. 10, Issue 6
A Learning Algorithm for Continually Running Fully Recurrent Neural Networks
journal, June 1989
- Williams, Ronald J.; Zipser, David
- Neural Computation, Vol. 1, Issue 2
A Tutorial on Lateral Boundary Conditions as a Basic and Potentially Serious Limitation to Regional Numerical Weather Prediction
journal, November 1997
- Warner, Thomas T.; Peterson, Ralph A.; Treadon, Russell E.
- Bulletin of the American Meteorological Society, Vol. 78, Issue 11
Evaluation of satellite rainfall estimates over Ethiopian river basins
journal, January 2011
- Romilly, T. G.; Gebremichael, M.
- Hydrology and Earth System Sciences, Vol. 15, Issue 5
Quantitative Precipitation Nowcasting: A Lagrangian Pixel-Based Approach
journal, November 2012
- Zahraei, Ali; Hsu, Kuo-lin; Sorooshian, Soroosh
- Atmospheric Research, Vol. 118
Learning to Forget: Continual Prediction with LSTM
journal, October 2000
- Gers, Felix A.; Schmidhuber, Jürgen; Cummins, Fred
- Neural Computation, Vol. 12, Issue 10
Short-Range Ensemble Forecasts of Precipitation during the Southwest Monsoon
journal, October 2002
- Bright, David R.; Mullen, Steven L.
- Weather and Forecasting, Vol. 17, Issue 5
Nowcasting of deep convective clouds and heavy precipitation: Comparison study between NWP model simulation and extrapolation
journal, February 2017
- Bližňák, Vojtěch; Sokol, Zbyněk; Zacharov, Petr
- Atmospheric Research, Vol. 184
Interannual Variability of the U.S. Summer Precipitation Regime with Emphasis on the Southwestern Monsoon
journal, October 1998
- Higgins, R. W.; Mo, K. C.; Yao, Y.
- Journal of Climate, Vol. 11, Issue 10
A quantitative comparison of precipitation forecasts between the storm-scale numerical weather prediction model and auto-nowcast system in Jiangsu, China
journal, November 2016
- Wang, Gaili; Yang, Ji; Wang, Dan
- Atmospheric Research, Vol. 181
Rainfall frequency analysis for ungauged regions using remotely sensed precipitation information
journal, August 2018
- Faridzad, Mohammad; Yang, Tiantian; Hsu, Kuolin
- Journal of Hydrology, Vol. 563
Short-term quantitative precipitation forecasting using an object-based approach
journal, March 2013
- Zahraei, Ali; Hsu, Kuo-lin; Sorooshian, Soroosh
- Journal of Hydrology, Vol. 483
Evaluation of satellite-retrieved extreme precipitation rates across the central United States
journal, January 2011
- AghaKouchak, A.; Behrangi, A.; Sorooshian, S.
- Journal of Geophysical Research, Vol. 116, Issue D2
A North American Hourly Assimilation and Model Forecast Cycle: The Rapid Refresh
journal, April 2016
- Benjamin, Stanley G.; Weygandt, Stephen S.; Brown, John M.
- Monthly Weather Review, Vol. 144, Issue 4
Recurrent nets that time and count
conference, January 2000
- Gers, F. A.; Schmidhuber, J.
- Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium
Speech recognition with deep recurrent neural networks
conference, May 2013
- Graves, Alex; Mohamed, Abdel-rahman; Hinton, Geoffrey
- ICASSP 2013 - 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Modeling Spatial-Temporal Clues in a Hybrid Deep Learning Framework for Video Classification
conference, October 2015
- Wu, Zuxuan; Wang, Xi; Jiang, Yu-Gang
- MM '15: ACM Multimedia Conference, Proceedings of the 23rd ACM international conference on Multimedia
National Mosaic and Multi-sensor QPE (NMQ) System – Description, Results and Future Plans
journal, June 2011
- Zhang, Jian; Howard, Kenneth; Langston, Carrie
- Bulletin of the American Meteorological Society
LSTM: A Search Space Odyssey
text, January 2015
- Greff, Klaus; Srivastava, Rupesh Kumar; Koutník, Jan
- arXiv
Works referencing / citing this record:
Conditional Generative Adversarial Networks (cGANs) for Near Real-Time Precipitation Estimation from Multispectral GOES-16 Satellite Imageries—PERSIANN-cGAN
journal, September 2019
- Hayatbini, Negin; Kong, Bailey; Hsu, Kuo-lin
- Remote Sensing, Vol. 11, Issue 19
Computer Vision in Precipitation Nowcasting: Applying Image Quality Assessment Metrics for Training Deep Neural Networks
journal, May 2019
- Tran, Quang-Khai; Song, Sa-kwang
- Atmosphere, Vol. 10, Issue 5
Lake Level Prediction using Feed Forward and Recurrent Neural Networks
journal, April 2019
- Hrnjica, Bahrudin; Bonacci, Ognjen
- Water Resources Management, Vol. 33, Issue 7