DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Complex relationship between seasonal streamflow forecast skill and value in reservoir operations

Abstract

Considerable research effort has recently been directed at improving and operationalising ensemble seasonal streamflow forecasts. Whilst this creates new opportunities for improving the performance of water resources systems, there may also be associated risks. Here, we explore these potential risks by examining the sensitivity of forecast value (improvement in system performance brought about by adopting forecasts) to changes in the forecast skill for a range of hypothetical reservoir designs with contrasting operating objectives. Forecast-informed operations are simulated using rolling horizon, adaptive control and then benchmarked against optimised control rules to assess performance improvements. Results show that there exists a strong relationship between forecast skill and value for systems operated to maintain a target water level. But this relationship breaks down when the reservoir is operated to satisfy a target demand for water; good forecast accuracy does not necessarily translate into performance improvement. We show that the primary cause of this behaviour is the buffering role played by storage in water supply reservoirs, which renders the forecast superfluous for long periods of the operation. System performance depends primarily on forecast accuracy when critical decisions are made – namely during severe drought. As it is not possible to know in advance ifmore » a forecast will perform well at such moments, we advocate measuring the consistency of forecast performance, through bootstrap resampling, to indicate potential usefulness in storage operations. Our results highlight the need for sensitivity assessment in value-of-forecast studies involving reservoirs with supply objectives.« less

Authors:
 [1]; ORCiD logo [2];  [3]; ORCiD logo [4]
  1. Pacific Northwest National Lab. (PNNL), Richland, WA (United States); Singapore Univ. of Technology and Design (Singapore). SUTD-MIT International Design Centre
  2. CSIRO, Melbourne, Clayton, Vic (Australia); Univ. of Tasmania, Hobart, TAS (Australia). Inst. for Marine and Antarctic Studies
  3. CSIRO, Melbourne, Clayton, Vic (Australia)
  4. Singapore Univ. of Technology and Design (Singapore). Pillar of Engineering Systems and Design
Publication Date:
Research Org.:
Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1398219
Report Number(s):
PNNL-SA-126975
Journal ID: ISSN 1607-7938
Grant/Contract Number:  
AC05-76RL01830; IDG 21400101
Resource Type:
Accepted Manuscript
Journal Name:
Hydrology and Earth System Sciences (Online)
Additional Journal Information:
Journal Name: Hydrology and Earth System Sciences (Online); Journal Volume: 21; Journal Issue: 9; Journal ID: ISSN 1607-7938
Publisher:
European Geosciences Union (EGU)
Country of Publication:
United States
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES; 42 ENGINEERING; dams; seasonal forecasts; reservoir operations; optimization

Citation Formats

Turner, Sean W. D., Bennett, James C., Robertson, David E., and Galelli, Stefano. Complex relationship between seasonal streamflow forecast skill and value in reservoir operations. United States: N. p., 2017. Web. doi:10.5194/hess-21-4841-2017.
Turner, Sean W. D., Bennett, James C., Robertson, David E., & Galelli, Stefano. Complex relationship between seasonal streamflow forecast skill and value in reservoir operations. United States. https://doi.org/10.5194/hess-21-4841-2017
Turner, Sean W. D., Bennett, James C., Robertson, David E., and Galelli, Stefano. Thu . "Complex relationship between seasonal streamflow forecast skill and value in reservoir operations". United States. https://doi.org/10.5194/hess-21-4841-2017. https://www.osti.gov/servlets/purl/1398219.
@article{osti_1398219,
title = {Complex relationship between seasonal streamflow forecast skill and value in reservoir operations},
author = {Turner, Sean W. D. and Bennett, James C. and Robertson, David E. and Galelli, Stefano},
abstractNote = {Considerable research effort has recently been directed at improving and operationalising ensemble seasonal streamflow forecasts. Whilst this creates new opportunities for improving the performance of water resources systems, there may also be associated risks. Here, we explore these potential risks by examining the sensitivity of forecast value (improvement in system performance brought about by adopting forecasts) to changes in the forecast skill for a range of hypothetical reservoir designs with contrasting operating objectives. Forecast-informed operations are simulated using rolling horizon, adaptive control and then benchmarked against optimised control rules to assess performance improvements. Results show that there exists a strong relationship between forecast skill and value for systems operated to maintain a target water level. But this relationship breaks down when the reservoir is operated to satisfy a target demand for water; good forecast accuracy does not necessarily translate into performance improvement. We show that the primary cause of this behaviour is the buffering role played by storage in water supply reservoirs, which renders the forecast superfluous for long periods of the operation. System performance depends primarily on forecast accuracy when critical decisions are made – namely during severe drought. As it is not possible to know in advance if a forecast will perform well at such moments, we advocate measuring the consistency of forecast performance, through bootstrap resampling, to indicate potential usefulness in storage operations. Our results highlight the need for sensitivity assessment in value-of-forecast studies involving reservoirs with supply objectives.},
doi = {10.5194/hess-21-4841-2017},
journal = {Hydrology and Earth System Sciences (Online)},
number = 9,
volume = 21,
place = {United States},
year = {2017},
month = {9}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 9 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Value of Seasonal Flow Forecasts in Bayesian Stochastic Programming
journal, November 1997


Optimal Hedging and Carryover Storage Value
journal, January 2004


Statistical calibration and bridging of ECMWF System4 outputs for forecasting seasonal precipitation over China: FORECASTING SEASONAL PRECIPITATION
journal, June 2014

  • Peng, Zhaoliang; Wang, Q. J.; Bennett, James C.
  • Journal of Geophysical Research: Atmospheres, Vol. 119, Issue 12
  • DOI: 10.1002/2013JD021162

Improved regional water management utilizing climate forecasts: An interbasin transfer model with a risk management framework
journal, August 2014

  • Li, Weihua; Sankarasubramanian, A.; Ranjithan, R. S.
  • Water Resources Research, Vol. 50, Issue 8
  • DOI: 10.1002/2013WR015248

Intra-seasonal drivers of extreme heat over Australia in observations and POAMA-2
journal, December 2013


Economic Value of Long-Lead Streamflow Forecasts for Columbia River Hydropower
journal, March 2002


Providing Seasonal-to-Interannual Climate Information for Risk Management and Decision-making
journal, January 2010


Monthly versus daily water balance models in simulating monthly runoff
journal, July 2011


Tailoring seasonal climate forecasts for hydropower operations
journal, January 2011


Constrained model predictive control: Stability and optimality
journal, June 2000


The End of Reliability
journal, March 2010


Strictly Proper Scoring Rules, Prediction, and Estimation
journal, March 2007

  • Gneiting, Tilmann; Raftery, Adrian E.
  • Journal of the American Statistical Association, Vol. 102, Issue 477
  • DOI: 10.1198/016214506000001437

Tree-based reinforcement learning for optimal water reservoir operation: FITTED
journal, September 2010

  • Castelletti, A.; Galelli, S.; Restelli, M.
  • Water Resources Research, Vol. 46, Issue 9
  • DOI: 10.1029/2009WR008898

A strategy to overcome adverse effects of autoregressive updating of streamflow forecasts
journal, January 2015

  • Li, M.; Wang, Q. J.; Bennett, J. C.
  • Hydrology and Earth System Sciences, Vol. 19, Issue 1
  • DOI: 10.5194/hess-19-1-2015

Seasonal Forecasts of Australian Rainfall through Calibration and Bridging of Coupled GCM Outputs
journal, May 2014

  • Schepen, Andrew; Wang, Q. J.; Robertson, David E.
  • Monthly Weather Review, Vol. 142, Issue 5
  • DOI: 10.1175/MWR-D-13-00248.1

Limited multi-stage stochastic programming for managing water supply systems
journal, March 2013


Joint and respective effects of long- and short-term forecast uncertainties on reservoir operations
journal, September 2014


Water: Megacities running dry in Brazil
journal, May 2015

  • Meganck, Richard; Havens, Karl; Pinto-Coelho, Ricardo M.
  • Nature, Vol. 521, Issue 7552
  • DOI: 10.1038/521289c

Effect of streamflow forecast uncertainty on real-time reservoir operation
journal, April 2011


Western U.S. Water Supply Forecasting: A Tradition Evolves
journal, January 2014

  • Pagano, Thomas; Wood, Andrew; Werner, Kevin
  • Eos, Transactions American Geophysical Union, Vol. 95, Issue 3
  • DOI: 10.1002/2014EO030007

Improving Intraseasonal Prediction with a New Ensemble Generation Strategy
journal, December 2013

  • Hudson, Debra; Marshall, Andrew G.; Yin, Yonghong
  • Monthly Weather Review, Vol. 141, Issue 12
  • DOI: 10.1175/MWR-D-13-00059.1

Value of adaptive water resources management in Northern California under climatic variability and change: Reservoir management
journal, January 2012


Streamflow decline in southwestern Australia, 1950-2008: STREAMFLOW DECLINE
journal, June 2010

  • Petrone, Kevin C.; Hughes, Justin D.; Van Niel, Thomas G.
  • Geophysical Research Letters, Vol. 37, Issue 11
  • DOI: 10.1029/2010GL043102

Short-term optimal operation of water systems using ensemble forecasts
journal, September 2014


Weather Forecasts are for Wimps: Why Water Resource Managers Do Not Use Climate Forecasts
journal, April 2005


Stochastic dynamic programming models for reservoir operation optimization
journal, November 1984

  • Stedinger, Jery R.; Sule, Bola F.; Loucks, Daniel P.
  • Water Resources Research, Vol. 20, Issue 11
  • DOI: 10.1029/WR020i011p01499

Hydro-economic assessment of hydrological forecasting systems
journal, January 2012


Dynamic Programming and Lagrange Multipliers
journal, October 1956


Modeling the Evolution of Demand Forecasts ith Application to Safety Stock Analysis in Production/Distribution Systems
journal, May 1994


Reservoir optimization using sampling SDP with ensemble streamflow prediction (ESP) forecasts
journal, August 2001


Scenario tree reduction in stochastic programming with recourse for hydropower operations: SCENARIO TREE REDUCTION IN STOCHASTIC PROGRAMMING
journal, August 2015

  • Xu, Bin; Zhong, Ping-An; Zambon, Renato C.
  • Water Resources Research, Vol. 51, Issue 8
  • DOI: 10.1002/2014WR016828

High-resolution projections of surface water availability for Tasmania, Australia
journal, January 2012

  • Bennett, J. C.; Ling, F. L. N.; Post, D. A.
  • Hydrology and Earth System Sciences, Vol. 16, Issue 5
  • DOI: 10.5194/hess-16-1287-2012

Toward Understanding the Value of Climate Information for Multiobjective Reservoir Management under Present and Future Climate and Demand Scenarios
journal, April 2010

  • Graham, Nicholas E.; Georgakakos, Konstantine P.
  • Journal of Applied Meteorology and Climatology, Vol. 49, Issue 4
  • DOI: 10.1175/2009JAMC2135.1

Error reduction and representation in stages (ERRIS) in hydrological modelling for ensemble streamflow forecasting
journal, January 2016

  • Li, Ming; Wang, Q. J.; Bennett, James C.
  • Hydrology and Earth System Sciences, Vol. 20, Issue 9
  • DOI: 10.5194/hess-20-3561-2016

Drought and Desalination: Melbourne water supply and development choices in the twenty-first century
journal, August 2014

  • Porter, Michael G.; Downie, David; Scarborough, Helen
  • Desalination and Water Treatment, Vol. 55, Issue 9
  • DOI: 10.1080/19443994.2014.959743

A Simple Framework for Incorporating Seasonal Streamflow Forecasts into Existing Water Resource Management Practices 1 : A S
journal, April 2010


High-quality spatial climate data-sets for Australia
journal, December 2009

  • Jones, D.; Wang, W.; Fawcett, R.
  • Australian Meteorological and Oceanographic Journal, Vol. 58, Issue 04
  • DOI: 10.22499/2.5804.003

Technical Note: Initial assessment of a multi-method approach to spring-flood forecasting in Sweden
journal, January 2016

  • Olsson, J.; Uvo, C. B.; Foster, K.
  • Hydrology and Earth System Sciences, Vol. 20, Issue 2
  • DOI: 10.5194/hess-20-659-2016

A log-sinh transformation for data normalization and variance stabilization: A LOG-SINH TRANSFORMATION
journal, May 2012

  • Wang, Q. J.; Shrestha, D. L.; Robertson, D. E.
  • Water Resources Research, Vol. 48, Issue 5
  • DOI: 10.1029/2011WR010973

Decision Support System for Optimizing Reservoir Operations Using Ensemble Streamflow Predictions
journal, January 2011


Accounting for seasonal dependence in hydrological model errors and prediction uncertainty: Seasonal Dependence of Model Error Structure
journal, September 2013

  • Li, Ming; Wang, Q. J.; Bennett, James
  • Water Resources Research, Vol. 49, Issue 9
  • DOI: 10.1002/wrcr.20445

Assessment of an ensemble seasonal streamflow forecasting system for Australia
journal, January 2017

  • Bennett, James C.; Wang, Quan J.; Robertson, David E.
  • Hydrology and Earth System Sciences, Vol. 21, Issue 12
  • DOI: 10.5194/hess-21-6007-2017

Providing Seasonal-to-Interannual Climate Information for Risk Management and Decision-making
text, January 2010

  • Goddard, Lisa M.; Aitchellouche, Y.; Baethgen, Walter E.
  • Columbia University
  • DOI: 10.7916/d8765f84

Works referencing / citing this record:

A Clustering Preprocessing Framework for the Subannual Calibration of a Hydrological Model Considering Climate‐Land Surface Variations
journal, December 2018

  • Lan, T.; Lin, K. R.; Liu, Z. Y.
  • Water Resources Research, Vol. 54, Issue 12
  • DOI: 10.1029/2018wr023160

Balancing Flood Risk and Water Supply in California: Policy Search Integrating Short‐Term Forecast Ensembles With Conjunctive Use
journal, October 2018

  • Nayak, Munir Ahmad; Herman, Jonathan D.; Steinschneider, Scott
  • Water Resources Research, Vol. 54, Issue 10
  • DOI: 10.1029/2018wr023177

On the Value of ENSO State for Urban Water Supply System Operators: Opportunities, Trade‐Offs, and Challenges
journal, April 2019

  • Libisch‐Lehner, C. P.; Nguyen, H. T. T.; Taormina, R.
  • Water Resources Research, Vol. 55, Issue 4
  • DOI: 10.1029/2018wr023622

Prediction of Reservoir Storage Anomalies in India
journal, April 2019

  • Tiwari, Amar Deep; Mishra, Vimal
  • Journal of Geophysical Research: Atmospheres, Vol. 124, Issue 7
  • DOI: 10.1029/2019jd030525

Detecting the State of the Climate System via Artificial Intelligence to Improve Seasonal Forecasts and Inform Reservoir Operations
journal, November 2019

  • Giuliani, Matteo; Zaniolo, Marta; Castelletti, Andrea
  • Water Resources Research, Vol. 55, Issue 11
  • DOI: 10.1029/2019wr025035

Seasonal Hydropower Planning for Data‐Scarce Regions Using Multimodel Ensemble Forecasts, Remote Sensing Data, and Stochastic Programming
journal, November 2019

  • Koppa, Akash; Gebremichael, Mekonnen; Zambon, Renato C.
  • Water Resources Research, Vol. 55, Issue 11
  • DOI: 10.1029/2019wr025228

The Value of Subseasonal Hydrometeorological Forecasts to Hydropower Operations: How Much Does Preprocessing Matter?
journal, December 2019

  • Anghileri, D.; Monhart, S.; Zhou, C.
  • Water Resources Research, Vol. 55, Issue 12
  • DOI: 10.1029/2019wr025280

Spatio-temporal changes and their relationship in water resources and agricultural disasters across China
journal, March 2019


Can seasonal hydrological forecasts inform local decisions and actions? A decision-making activity
journal, January 2018

  • Neumann, Jessica L.; Arnal, Louise; Emerton, Rebecca E.
  • Geoscience Communication, Vol. 1, Issue 1
  • DOI: 10.5194/gc-1-35-2018

Assessment of an ensemble seasonal streamflow forecasting system for Australia
journal, January 2017

  • Bennett, James C.; Wang, Quan J.; Robertson, David E.
  • Hydrology and Earth System Sciences, Vol. 21, Issue 12
  • DOI: 10.5194/hess-21-6007-2017

Skilful seasonal forecasts of streamflow over Europe?
journal, January 2018

  • Arnal, Louise; Cloke, Hannah L.; Stephens, Elisabeth
  • Hydrology and Earth System Sciences, Vol. 22, Issue 4
  • DOI: 10.5194/hess-22-2057-2018

Evaluating post-processing approaches for monthly and seasonal streamflow forecasts
journal, January 2018

  • Woldemeskel, Fitsum; McInerney, David; Lerat, Julien
  • Hydrology and Earth System Sciences, Vol. 22, Issue 12
  • DOI: 10.5194/hess-22-6257-2018