DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Short-Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks

Abstract

Short-term Quantitative Precipitation Forecasting is important for flood forecasting, early flood warning, and natural hazard management. This study proposes a precipitation forecast model by extrapolating Cloud-Top Brightness Temperature (CTBT) using advanced Deep Neural Networks, and applying the forecasted CTBT into an effective rainfall retrieval algorithm to obtain the Short-term Quantitative Precipitation Forecasting (0–6 hr). To achieve such tasks, we propose a Long Short-Term Memory (LSTM) and the Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN), respectively. The precipitation forecasts obtained from our proposed framework, (i.e., LSTM combined with PERSIANN) are compared with a Recurrent Neural Network (RNN), Persistency method, and Farneback optical flow each combined with PERSIANN algorithm and the numerical model results from the first version of Rapid Refresh (RAPv1.0) over three regions in the United States, including the states of Oregon, Oklahoma, and Florida. We report our experiments indicate better statistics, such as correlation coefficient and root-mean-square error, for the CTBT forecasts from the proposed LSTM compared to the RNN, Persistency, and the Farneback method. The precipitation forecasts from the proposed LSTM and PERSIANN framework has demonstrated better statistics compared to the RAPv1.0 numerical forecasts and PERSIANN estimations from RNN, Persistency, and Farneback projections inmore » terms of Probability of Detection, False Alarm Ratio, Critical Success Index, correlation coefficient, and root-mean-square error, especially in predicting the convective rainfalls. The proposed method shows superior capabilities in short-term forecasting over compared methods, and has the potential to be implemented globally as an alternative short-term forecast product.« less

Authors:
ORCiD logo [1]; ORCiD logo [2];  [3]; ORCiD logo [1];  [4];  [4]
  1. Univ. of California, Irvine, CA (United States)
  2. Univ. of California, Irvine, CA (United States); Univ. of Oklahoma, Norman, OK (United States)
  3. Univ. of California, Irvine, CA (United States); National Taiwan Ocean Univ., Keelung (Taiwan)
  4. China Inst. of Water Resources and Hydropower Research, Beijing (China)
Publication Date:
Research Org.:
Univ. of California, Oakland, CA (United States)
Sponsoring Org.:
USDOE Office of International Affairs (IA); California Energy Commission; National Science Foundation (NSF); National Oceanic and Atmospheric Administration (NOAA); National Environmental Satellite, Data, and Information Service (NESDIS); National Climatic Data Center (NCDC); US Army Research Office (ARO)
OSTI Identifier:
1613787
Alternate Identifier(s):
OSTI ID: 1482741
Grant/Contract Number:  
IA0000018; 300-15-005; CCF-1331915; NA09NES4400006; NCSU CICS; W911NF-11-1-0422
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Geophysical Research: Atmospheres
Additional Journal Information:
Journal Volume: 123; Journal Issue: 22; Journal ID: ISSN 2169-897X
Publisher:
American Geophysical Union
Country of Publication:
United States
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES; 37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY; meteorology & atmospheric sciences; deep learning; LSTM; RNN; PERSIANN system; precipitation forecast; Rapid Refresh

Citation Formats

Akbari Asanjan, Ata, Yang, Tiantian, Hsu, Kuolin, Sorooshian, Soroosh, Lin, Junqiang, and Peng, Qidong. Short-Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks. United States: N. p., 2018. Web. doi:10.1029/2018jd028375.
Akbari Asanjan, Ata, Yang, Tiantian, Hsu, Kuolin, Sorooshian, Soroosh, Lin, Junqiang, & Peng, Qidong. Short-Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks. United States. https://doi.org/10.1029/2018jd028375
Akbari Asanjan, Ata, Yang, Tiantian, Hsu, Kuolin, Sorooshian, Soroosh, Lin, Junqiang, and Peng, Qidong. Mon . "Short-Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks". United States. https://doi.org/10.1029/2018jd028375. https://www.osti.gov/servlets/purl/1613787.
@article{osti_1613787,
title = {Short-Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks},
author = {Akbari Asanjan, Ata and Yang, Tiantian and Hsu, Kuolin and Sorooshian, Soroosh and Lin, Junqiang and Peng, Qidong},
abstractNote = {Short-term Quantitative Precipitation Forecasting is important for flood forecasting, early flood warning, and natural hazard management. This study proposes a precipitation forecast model by extrapolating Cloud-Top Brightness Temperature (CTBT) using advanced Deep Neural Networks, and applying the forecasted CTBT into an effective rainfall retrieval algorithm to obtain the Short-term Quantitative Precipitation Forecasting (0–6 hr). To achieve such tasks, we propose a Long Short-Term Memory (LSTM) and the Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN), respectively. The precipitation forecasts obtained from our proposed framework, (i.e., LSTM combined with PERSIANN) are compared with a Recurrent Neural Network (RNN), Persistency method, and Farneback optical flow each combined with PERSIANN algorithm and the numerical model results from the first version of Rapid Refresh (RAPv1.0) over three regions in the United States, including the states of Oregon, Oklahoma, and Florida. We report our experiments indicate better statistics, such as correlation coefficient and root-mean-square error, for the CTBT forecasts from the proposed LSTM compared to the RNN, Persistency, and the Farneback method. The precipitation forecasts from the proposed LSTM and PERSIANN framework has demonstrated better statistics compared to the RAPv1.0 numerical forecasts and PERSIANN estimations from RNN, Persistency, and Farneback projections in terms of Probability of Detection, False Alarm Ratio, Critical Success Index, correlation coefficient, and root-mean-square error, especially in predicting the convective rainfalls. The proposed method shows superior capabilities in short-term forecasting over compared methods, and has the potential to be implemented globally as an alternative short-term forecast product.},
doi = {10.1029/2018jd028375},
journal = {Journal of Geophysical Research: Atmospheres},
number = 22,
volume = 123,
place = {United States},
year = {Mon Oct 29 00:00:00 EDT 2018},
month = {Mon Oct 29 00:00:00 EDT 2018}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 98 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Comparison of PERSIANN and V7 TRMM Multi-satellite Precipitation Analysis (TMPA) products with rain gauge data over Iran
journal, September 2013

  • Moazami, Saber; Golian, Saeed; Kavianpour, M. Reza
  • International Journal of Remote Sensing, Vol. 34, Issue 22
  • DOI: 10.1080/01431161.2013.833360

Recurrent neural networks and robust time series prediction
journal, March 1994

  • Connor, J. T.; Martin, R. D.; Atlas, L. E.
  • IEEE Transactions on Neural Networks, Vol. 5, Issue 2
  • DOI: 10.1109/72.279188

Developing reservoir monthly inflow forecasts using artificial intelligence and climate phenomenon information: RESERVOIR INFLOW FORECASTS
journal, April 2017

  • Yang, Tiantian; Asanjan, Ata Akbari; Welles, Edwin
  • Water Resources Research, Vol. 53, Issue 4
  • DOI: 10.1002/2017WR020482

National Mosaic and Multi-Sensor QPE (NMQ) System: Description, Results, and Future Plans
journal, October 2011

  • Zhang, Jian; Howard, Kenneth; Langston, Carrie
  • Bulletin of the American Meteorological Society, Vol. 92, Issue 10
  • DOI: 10.1175/2011BAMS-D-11-00047.1

An enhanced artificial neural network with a shuffled complex evolutionary global optimization with principal component analysis
journal, December 2017


A Microwave Infrared Threshold Technique to Improve the GOES Precipitation Index
journal, May 1999


Use of NWP for Nowcasting Convective Precipitation: Recent Progress and Challenges
journal, March 2014

  • Sun, Juanzhen; Xue, Ming; Wilson, James W.
  • Bulletin of the American Meteorological Society, Vol. 95, Issue 3
  • DOI: 10.1175/BAMS-D-11-00263.1

Self-organized formation of topologically correct feature maps
journal, January 1982


LSTM: A Search Space Odyssey
journal, October 2017

  • Greff, Klaus; Srivastava, Rupesh K.; Koutnik, Jan
  • IEEE Transactions on Neural Networks and Learning Systems, Vol. 28, Issue 10
  • DOI: 10.1109/TNNLS.2016.2582924

Finding Structure in Time
journal, March 1990


Evaluation of numerical weather prediction model precipitation forecasts for short-term streamflow forecasting purpose
journal, January 2013

  • Shrestha, D. L.; Robertson, D. E.; Wang, Q. J.
  • Hydrology and Earth System Sciences, Vol. 17, Issue 5
  • DOI: 10.5194/hess-17-1913-2013

Distributed Quantitative Precipitation Forecasting Using Information from Radar and Numerical Weather Prediction Models
journal, December 2003


Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
conference, January 2014

  • Cho, Kyunghyun; van Merrienboer, Bart; Gulcehre, Caglar
  • Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)
  • DOI: 10.3115/v1/D14-1179

Rainfall forecasting in space and time using a neural network
journal, August 1992


Nimrod: A system for generating automated very short range forecasts
journal, March 1998


Generalization of backpropagation with application to a recurrent gas market model
journal, January 1988


Evaluating the streamflow simulation capability of PERSIANN-CDR daily rainfall products in two river basins on the Tibetan Plateau
journal, January 2017

  • Liu, Xiaomang; Yang, Tiantian; Hsu, Koulin
  • Hydrology and Earth System Sciences, Vol. 21, Issue 1
  • DOI: 10.5194/hess-21-169-2017

Framewise phoneme classification with bidirectional LSTM and other neural network architectures
journal, July 2005


Precipitation Forecasting Using a Neural Network
journal, June 1999


Experiments in Short-Term Precipitation Forecasting Using Artificial Neural Networks
journal, February 1998


Post-processing rainfall forecasts from numerical weather prediction models for short-term streamflow forecasting
journal, January 2013

  • Robertson, D. E.; Shrestha, D. L.; Wang, Q. J.
  • Hydrology and Earth System Sciences, Vol. 17, Issue 9
  • DOI: 10.5194/hess-17-3587-2013

Localized Precipitation Forecasts from a Numerical Weather Prediction Model Using Artificial Neural Networks
journal, December 1998


Scene labeling with LSTM recurrent neural networks
conference, June 2015

  • Byeon, Wonmin; Breuel, Thomas M.; Raue, Federico
  • 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • DOI: 10.1109/CVPR.2015.7298977

Long Short-Term Memory
journal, November 1997


Performance of 4D-Var NWP-based nowcasting of precipitation at the Met Office for summer 2012: 4D-Var NWP-based Nowcasting of Precipitation
journal, November 2015

  • Ballard, Susan P.; Li, Zhihong; Simonin, David
  • Quarterly Journal of the Royal Meteorological Society, Vol. 142, Issue 694
  • DOI: 10.1002/qj.2665

The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions
journal, April 1998

  • Hochreiter, Sepp
  • International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, Vol. 06, Issue 02
  • DOI: 10.1142/S0218488598000094

Consensus Clustering of U.S. Temperature and Precipitation Data
journal, June 1997


Evaluation of satellite-based precipitation estimation over Iran
journal, October 2013


The estimation of global monthly mean rainfall using infrared satellite data: The GOES precipitation index (GPI)
journal, October 1994

  • Arkin, Phillip A.; Joyce, Robert; Janowiak, John E.
  • Remote Sensing Reviews, Vol. 11, Issue 1-4
  • DOI: 10.1080/02757259409532261

Development and verification of a real-time stochastic precipitation nowcasting system for urban hydrology in Belgium
journal, January 2016

  • Foresti, L.; Reyniers, M.; Seed, A.
  • Hydrology and Earth System Sciences, Vol. 20, Issue 1
  • DOI: 10.5194/hess-20-505-2016

Improving QPE and Very Short Term QPF: An Initiative for a Community-Wide Integrated Approach
journal, December 2007

  • Vasiloff, Steven V.; Seo, Dong-Jun; Howard, Kenneth W.
  • Bulletin of the American Meteorological Society, Vol. 88, Issue 12
  • DOI: 10.1175/BAMS-88-12-1899

Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks
journal, September 1997


An Automated Technique to Quality Control Radar Reflectivity Data
journal, March 2007

  • Lakshmanan, Valliappa; Fritz, Angela; Smith, Travis
  • Journal of Applied Meteorology and Climatology, Vol. 46, Issue 3
  • DOI: 10.1175/JAM2460.1

PERSIANN-MSA: A Precipitation Estimation Method from Satellite-Based Multispectral Analysis
journal, December 2009

  • Behrangi, Ali; Hsu, Kuo-lin; Imam, Bisher
  • Journal of Hydrometeorology, Vol. 10, Issue 6
  • DOI: 10.1175/2009JHM1139.1

A Learning Algorithm for Continually Running Fully Recurrent Neural Networks
journal, June 1989


A Tutorial on Lateral Boundary Conditions as a Basic and Potentially Serious Limitation to Regional Numerical Weather Prediction
journal, November 1997


Evaluation of satellite rainfall estimates over Ethiopian river basins
journal, January 2011


Quantitative Precipitation Nowcasting: A Lagrangian Pixel-Based Approach
journal, November 2012


Learning to Forget: Continual Prediction with LSTM
journal, October 2000


Short-Range Ensemble Forecasts of Precipitation during the Southwest Monsoon
journal, October 2002


Nowcasting of deep convective clouds and heavy precipitation: Comparison study between NWP model simulation and extrapolation
journal, February 2017


Interannual Variability of the U.S. Summer Precipitation Regime with Emphasis on the Southwestern Monsoon
journal, October 1998


Rainfall frequency analysis for ungauged regions using remotely sensed precipitation information
journal, August 2018


Short-term quantitative precipitation forecasting using an object-based approach
journal, March 2013


Evaluation of satellite-retrieved extreme precipitation rates across the central United States
journal, January 2011

  • AghaKouchak, A.; Behrangi, A.; Sorooshian, S.
  • Journal of Geophysical Research, Vol. 116, Issue D2
  • DOI: 10.1029/2010JD014741

A North American Hourly Assimilation and Model Forecast Cycle: The Rapid Refresh
journal, April 2016

  • Benjamin, Stanley G.; Weygandt, Stephen S.; Brown, John M.
  • Monthly Weather Review, Vol. 144, Issue 4
  • DOI: 10.1175/MWR-D-15-0242.1

Recurrent nets that time and count
conference, January 2000

  • Gers, F. A.; Schmidhuber, J.
  • Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium
  • DOI: 10.1109/IJCNN.2000.861302

Speech recognition with deep recurrent neural networks
conference, May 2013

  • Graves, Alex; Mohamed, Abdel-rahman; Hinton, Geoffrey
  • ICASSP 2013 - 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • DOI: 10.1109/ICASSP.2013.6638947

Modeling Spatial-Temporal Clues in a Hybrid Deep Learning Framework for Video Classification
conference, October 2015

  • Wu, Zuxuan; Wang, Xi; Jiang, Yu-Gang
  • MM '15: ACM Multimedia Conference, Proceedings of the 23rd ACM international conference on Multimedia
  • DOI: 10.1145/2733373.2806222

National Mosaic and Multi-sensor QPE (NMQ) System – Description, Results and Future Plans
journal, June 2011

  • Zhang, Jian; Howard, Kenneth; Langston, Carrie
  • Bulletin of the American Meteorological Society
  • DOI: 10.1175/bams-d-11-00047.1

Convolutional Neural Networks
text, January 2019


LSTM: A Search Space Odyssey
text, January 2015


Works referencing / citing this record:

Lake Level Prediction using Feed Forward and Recurrent Neural Networks
journal, April 2019