Complex relationship between seasonal streamflow forecast skill and value in reservoir operations
Abstract
Considerable research effort has recently been directed at improving and operationalising ensemble seasonal streamflow forecasts. Whilst this creates new opportunities for improving the performance of water resources systems, there may also be associated risks. Here, we explore these potential risks by examining the sensitivity of forecast value (improvement in system performance brought about by adopting forecasts) to changes in the forecast skill for a range of hypothetical reservoir designs with contrasting operating objectives. Forecast-informed operations are simulated using rolling horizon, adaptive control and then benchmarked against optimised control rules to assess performance improvements. Results show that there exists a strong relationship between forecast skill and value for systems operated to maintain a target water level. But this relationship breaks down when the reservoir is operated to satisfy a target demand for water; good forecast accuracy does not necessarily translate into performance improvement. We show that the primary cause of this behaviour is the buffering role played by storage in water supply reservoirs, which renders the forecast superfluous for long periods of the operation. System performance depends primarily on forecast accuracy when critical decisions are made – namely during severe drought. As it is not possible to know in advance ifmore »
- Authors:
-
- Pacific Northwest National Lab. (PNNL), Richland, WA (United States); Singapore Univ. of Technology and Design (Singapore). SUTD-MIT International Design Centre
- CSIRO, Melbourne, Clayton, Vic (Australia); Univ. of Tasmania, Hobart, TAS (Australia). Inst. for Marine and Antarctic Studies
- CSIRO, Melbourne, Clayton, Vic (Australia)
- Singapore Univ. of Technology and Design (Singapore). Pillar of Engineering Systems and Design
- Publication Date:
- Research Org.:
- Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1398219
- Report Number(s):
- PNNL-SA-126975
Journal ID: ISSN 1607-7938
- Grant/Contract Number:
- AC05-76RL01830; IDG 21400101
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Hydrology and Earth System Sciences (Online)
- Additional Journal Information:
- Journal Name: Hydrology and Earth System Sciences (Online); Journal Volume: 21; Journal Issue: 9; Journal ID: ISSN 1607-7938
- Publisher:
- European Geosciences Union (EGU)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 54 ENVIRONMENTAL SCIENCES; 42 ENGINEERING; dams; seasonal forecasts; reservoir operations; optimization
Citation Formats
Turner, Sean W. D., Bennett, James C., Robertson, David E., and Galelli, Stefano. Complex relationship between seasonal streamflow forecast skill and value in reservoir operations. United States: N. p., 2017.
Web. doi:10.5194/hess-21-4841-2017.
Turner, Sean W. D., Bennett, James C., Robertson, David E., & Galelli, Stefano. Complex relationship between seasonal streamflow forecast skill and value in reservoir operations. United States. https://doi.org/10.5194/hess-21-4841-2017
Turner, Sean W. D., Bennett, James C., Robertson, David E., and Galelli, Stefano. Thu .
"Complex relationship between seasonal streamflow forecast skill and value in reservoir operations". United States. https://doi.org/10.5194/hess-21-4841-2017. https://www.osti.gov/servlets/purl/1398219.
@article{osti_1398219,
title = {Complex relationship between seasonal streamflow forecast skill and value in reservoir operations},
author = {Turner, Sean W. D. and Bennett, James C. and Robertson, David E. and Galelli, Stefano},
abstractNote = {Considerable research effort has recently been directed at improving and operationalising ensemble seasonal streamflow forecasts. Whilst this creates new opportunities for improving the performance of water resources systems, there may also be associated risks. Here, we explore these potential risks by examining the sensitivity of forecast value (improvement in system performance brought about by adopting forecasts) to changes in the forecast skill for a range of hypothetical reservoir designs with contrasting operating objectives. Forecast-informed operations are simulated using rolling horizon, adaptive control and then benchmarked against optimised control rules to assess performance improvements. Results show that there exists a strong relationship between forecast skill and value for systems operated to maintain a target water level. But this relationship breaks down when the reservoir is operated to satisfy a target demand for water; good forecast accuracy does not necessarily translate into performance improvement. We show that the primary cause of this behaviour is the buffering role played by storage in water supply reservoirs, which renders the forecast superfluous for long periods of the operation. System performance depends primarily on forecast accuracy when critical decisions are made – namely during severe drought. As it is not possible to know in advance if a forecast will perform well at such moments, we advocate measuring the consistency of forecast performance, through bootstrap resampling, to indicate potential usefulness in storage operations. Our results highlight the need for sensitivity assessment in value-of-forecast studies involving reservoirs with supply objectives.},
doi = {10.5194/hess-21-4841-2017},
journal = {Hydrology and Earth System Sciences (Online)},
number = 9,
volume = 21,
place = {United States},
year = {2017},
month = {9}
}
Web of Science
Works referenced in this record:
The future of water resources systems analysis: Toward a scientific framework for sustainable water management: THE FUTURE OF WATER RESOURCES SYSTEMS ANALYSIS
journal, August 2015
- Brown, Casey M.; Lund, Jay R.; Cai, Ximing
- Water Resources Research, Vol. 51, Issue 8
Value of Seasonal Flow Forecasts in Bayesian Stochastic Programming
journal, November 1997
- Kim, Young-Oh; Palmer, Richard N.
- Journal of Water Resources Planning and Management, Vol. 123, Issue 6
Reliable long-range ensemble streamflow forecasts: Combining calibrated climate forecasts with a conceptual runoff model and a staged error model: LONG-RANGE ENSEMBLE STREAMFLOW FORECASTS
journal, October 2016
- Bennett, James C.; Wang, Q. J.; Li, Ming
- Water Resources Research, Vol. 52, Issue 10
Optimal Hedging and Carryover Storage Value
journal, January 2004
- Draper, Andrew J.; Lund, Jay R.
- Journal of Water Resources Planning and Management, Vol. 130, Issue 1
Statistical calibration and bridging of ECMWF System4 outputs for forecasting seasonal precipitation over China: FORECASTING SEASONAL PRECIPITATION
journal, June 2014
- Peng, Zhaoliang; Wang, Q. J.; Bennett, James C.
- Journal of Geophysical Research: Atmospheres, Vol. 119, Issue 12
Improved regional water management utilizing climate forecasts: An interbasin transfer model with a risk management framework
journal, August 2014
- Li, Weihua; Sankarasubramanian, A.; Ranjithan, R. S.
- Water Resources Research, Vol. 50, Issue 8
Intra-seasonal drivers of extreme heat over Australia in observations and POAMA-2
journal, December 2013
- Marshall, A. G.; Hudson, D.; Wheeler, M. C.
- Climate Dynamics, Vol. 43, Issue 7-8
Economic Value of Long-Lead Streamflow Forecasts for Columbia River Hydropower
journal, March 2002
- Hamlet, Alan F.; Huppert, Daniel; Lettenmaier, Dennis P.
- Journal of Water Resources Planning and Management, Vol. 128, Issue 2
Providing Seasonal-to-Interannual Climate Information for Risk Management and Decision-making
journal, January 2010
- Goddard, L.; Aitchellouche, Y.; Baethgen, W.
- Procedia Environmental Sciences, Vol. 1
Monthly versus daily water balance models in simulating monthly runoff
journal, July 2011
- Wang, Q. J.; Pagano, T. C.; Zhou, S. L.
- Journal of Hydrology, Vol. 404, Issue 3-4
Tailoring seasonal climate forecasts for hydropower operations
journal, January 2011
- Block, P.
- Hydrology and Earth System Sciences, Vol. 15, Issue 4
Regime-shifting streamflow processes: Implications for water supply reservoir operations: REGIME-SHIFTING STREAMFLOW AND WATER RESERVOIR OPERATIONS
journal, May 2016
- Turner, S. W. D.; Galelli, S.
- Water Resources Research, Vol. 52, Issue 5
Constrained model predictive control: Stability and optimality
journal, June 2000
- Mayne, D. Q.; Rawlings, J. B.; Rao, C. V.
- Automatica, Vol. 36, Issue 6
The End of Reliability
journal, March 2010
- Brown, Casey
- Journal of Water Resources Planning and Management, Vol. 136, Issue 2
Strictly Proper Scoring Rules, Prediction, and Estimation
journal, March 2007
- Gneiting, Tilmann; Raftery, Adrian E.
- Journal of the American Statistical Association, Vol. 102, Issue 477
Tree-based reinforcement learning for optimal water reservoir operation: FITTED
journal, September 2010
- Castelletti, A.; Galelli, S.; Restelli, M.
- Water Resources Research, Vol. 46, Issue 9
A strategy to overcome adverse effects of autoregressive updating of streamflow forecasts
journal, January 2015
- Li, M.; Wang, Q. J.; Bennett, J. C.
- Hydrology and Earth System Sciences, Vol. 19, Issue 1
Ensemble forecasts of monthly catchment rainfall out to long lead times by post-processing coupled general circulation model output
journal, November 2014
- Schepen, Andrew; Wang, Q. J.
- Journal of Hydrology, Vol. 519
Seasonal Forecasts of Australian Rainfall through Calibration and Bridging of Coupled GCM Outputs
journal, May 2014
- Schepen, Andrew; Wang, Q. J.; Robertson, David E.
- Monthly Weather Review, Vol. 142, Issue 5
Value of long-term streamflow forecasts to reservoir operations for water supply in snow-dominated river catchments: VALUE OF LONG-TERM FORECASTS TO RESERVOIR OPERATIONS
journal, June 2016
- Anghileri, D.; Voisin, N.; Castelletti, A.
- Water Resources Research, Vol. 52, Issue 6
Limited multi-stage stochastic programming for managing water supply systems
journal, March 2013
- Housh, Mashor; Ostfeld, Avi; Shamir, Uri
- Environmental Modelling & Software, Vol. 41
Joint and respective effects of long- and short-term forecast uncertainties on reservoir operations
journal, September 2014
- Zhao, Tongtiegang; Zhao, Jianshi
- Journal of Hydrology, Vol. 517
Water: Megacities running dry in Brazil
journal, May 2015
- Meganck, Richard; Havens, Karl; Pinto-Coelho, Ricardo M.
- Nature, Vol. 521, Issue 7552
Effect of streamflow forecast uncertainty on real-time reservoir operation
journal, April 2011
- Zhao, Tongtiegang; Cai, Ximing; Yang, Dawen
- Advances in Water Resources, Vol. 34, Issue 4
Western U.S. Water Supply Forecasting: A Tradition Evolves
journal, January 2014
- Pagano, Thomas; Wood, Andrew; Werner, Kevin
- Eos, Transactions American Geophysical Union, Vol. 95, Issue 3
Improving Intraseasonal Prediction with a New Ensemble Generation Strategy
journal, December 2013
- Hudson, Debra; Marshall, Andrew G.; Yin, Yonghong
- Monthly Weather Review, Vol. 141, Issue 12
Value of adaptive water resources management in Northern California under climatic variability and change: Reservoir management
journal, January 2012
- Georgakakos, A. P.; Yao, H.; Kistenmacher, M.
- Journal of Hydrology, Vol. 412-413
Streamflow decline in southwestern Australia, 1950-2008: STREAMFLOW DECLINE
journal, June 2010
- Petrone, Kevin C.; Hughes, Justin D.; Van Niel, Thomas G.
- Geophysical Research Letters, Vol. 37, Issue 11
Short-term optimal operation of water systems using ensemble forecasts
journal, September 2014
- Raso, L.; Schwanenberg, D.; van de Giesen, N. C.
- Advances in Water Resources, Vol. 71
Weather Forecasts are for Wimps: Why Water Resource Managers Do Not Use Climate Forecasts
journal, April 2005
- Rayner, Steve; Lach, Denise; Ingram, Helen
- Climatic Change, Vol. 69, Issue 2-3
Stochastic dynamic programming models for reservoir operation optimization
journal, November 1984
- Stedinger, Jery R.; Sule, Bola F.; Loucks, Daniel P.
- Water Resources Research, Vol. 20, Issue 11
Hydro-economic assessment of hydrological forecasting systems
journal, January 2012
- Boucher, M. -A.; Tremblay, D.; Delorme, L.
- Journal of Hydrology, Vol. 416-417
Dynamic Programming and Lagrange Multipliers
journal, October 1956
- Bellman, R.
- Proceedings of the National Academy of Sciences, Vol. 42, Issue 10
Modeling the Evolution of Demand Forecasts ith Application to Safety Stock Analysis in Production/Distribution Systems
journal, May 1994
- Heath, David C.; Jackson, Peter L.
- IIE Transactions, Vol. 26, Issue 3
Reservoir optimization using sampling SDP with ensemble streamflow prediction (ESP) forecasts
journal, August 2001
- Faber, B. A.; Stedinger, J. R.
- Journal of Hydrology, Vol. 249, Issue 1-4
A review on climate-model-based seasonal hydrologic forecasting: physical understanding and system development: A review on climate-model-based seasonal hydrologic forecasting
journal, May 2015
- Yuan, Xing; Wood, Eric F.; Ma, Zhuguo
- Wiley Interdisciplinary Reviews: Water, Vol. 2, Issue 5
Scenario tree reduction in stochastic programming with recourse for hydropower operations: SCENARIO TREE REDUCTION IN STOCHASTIC PROGRAMMING
journal, August 2015
- Xu, Bin; Zhong, Ping-An; Zambon, Renato C.
- Water Resources Research, Vol. 51, Issue 8
High-resolution projections of surface water availability for Tasmania, Australia
journal, January 2012
- Bennett, J. C.; Ling, F. L. N.; Post, D. A.
- Hydrology and Earth System Sciences, Vol. 16, Issue 5
Toward Understanding the Value of Climate Information for Multiobjective Reservoir Management under Present and Future Climate and Demand Scenarios
journal, April 2010
- Graham, Nicholas E.; Georgakakos, Konstantine P.
- Journal of Applied Meteorology and Climatology, Vol. 49, Issue 4
Error reduction and representation in stages (ERRIS) in hydrological
modelling for ensemble streamflow forecasting
journal, January 2016
- Li, Ming; Wang, Q. J.; Bennett, James C.
- Hydrology and Earth System Sciences, Vol. 20, Issue 9
Drought and Desalination: Melbourne water supply and development choices in the twenty-first century
journal, August 2014
- Porter, Michael G.; Downie, David; Scarborough, Helen
- Desalination and Water Treatment, Vol. 55, Issue 9
A Simple Framework for Incorporating Seasonal Streamflow Forecasts into Existing Water Resource Management Practices 1 : A S
journal, April 2010
- Gong, Gavin; Wang, Lucien; Condon, Laura
- JAWRA Journal of the American Water Resources Association, Vol. 46, Issue 3
Water supply sensitivity to climate change: An R package for implementing reservoir storage analysis in global and regional impact studies
journal, February 2016
- Turner, S. W. D.; Galelli, S.
- Environmental Modelling & Software, Vol. 76
Multisite probabilistic forecasting of seasonal flows for streams with zero value occurrences: MULTISITE PROBABILISTIC FORECASTING OF STREAMS
journal, February 2011
- Wang, Q. J.; Robertson, D. E.
- Water Resources Research, Vol. 47, Issue 2
High-quality spatial climate data-sets for Australia
journal, December 2009
- Jones, D.; Wang, W.; Fawcett, R.
- Australian Meteorological and Oceanographic Journal, Vol. 58, Issue 04
Technical Note: Initial assessment of a multi-method approach to spring-flood forecasting in Sweden
journal, January 2016
- Olsson, J.; Uvo, C. B.; Foster, K.
- Hydrology and Earth System Sciences, Vol. 20, Issue 2
A log-sinh transformation for data normalization and variance stabilization: A LOG-SINH TRANSFORMATION
journal, May 2012
- Wang, Q. J.; Shrestha, D. L.; Robertson, D. E.
- Water Resources Research, Vol. 48, Issue 5
Decision Support System for Optimizing Reservoir Operations Using Ensemble Streamflow Predictions
journal, January 2011
- Alemu, Eset T.; Palmer, Richard N.; Polebitski, Austin
- Journal of Water Resources Planning and Management, Vol. 137, Issue 1
Accounting for seasonal dependence in hydrological model errors and prediction uncertainty: Seasonal Dependence of Model Error Structure
journal, September 2013
- Li, Ming; Wang, Q. J.; Bennett, James
- Water Resources Research, Vol. 49, Issue 9
The Millennium Drought in southeast Australia (2001-2009): Natural and human causes and implications for water resources, ecosystems, economy, and society: CAUSES AND IMPACTS OF AUSTRALIA'S RECORD DROUGHT
journal, February 2013
- van Dijk, Albert I. J. M.; Beck, Hylke E.; Crosbie, Russell S.
- Water Resources Research, Vol. 49, Issue 2
Assessment of an ensemble seasonal streamflow forecasting system for Australia
journal, January 2017
- Bennett, James C.; Wang, Quan J.; Robertson, David E.
- Hydrology and Earth System Sciences, Vol. 21, Issue 12
Providing Seasonal-to-Interannual Climate Information for Risk Management and Decision-making
text, January 2010
- Goddard, Lisa M.; Aitchellouche, Y.; Baethgen, Walter E.
- Columbia University
Works referencing / citing this record:
A Clustering Preprocessing Framework for the Subannual Calibration of a Hydrological Model Considering Climate‐Land Surface Variations
journal, December 2018
- Lan, T.; Lin, K. R.; Liu, Z. Y.
- Water Resources Research, Vol. 54, Issue 12
Balancing Flood Risk and Water Supply in California: Policy Search Integrating Short‐Term Forecast Ensembles With Conjunctive Use
journal, October 2018
- Nayak, Munir Ahmad; Herman, Jonathan D.; Steinschneider, Scott
- Water Resources Research, Vol. 54, Issue 10
On the Value of ENSO State for Urban Water Supply System Operators: Opportunities, Trade‐Offs, and Challenges
journal, April 2019
- Libisch‐Lehner, C. P.; Nguyen, H. T. T.; Taormina, R.
- Water Resources Research, Vol. 55, Issue 4
Prediction of Reservoir Storage Anomalies in India
journal, April 2019
- Tiwari, Amar Deep; Mishra, Vimal
- Journal of Geophysical Research: Atmospheres, Vol. 124, Issue 7
Detecting the State of the Climate System via Artificial Intelligence to Improve Seasonal Forecasts and Inform Reservoir Operations
journal, November 2019
- Giuliani, Matteo; Zaniolo, Marta; Castelletti, Andrea
- Water Resources Research, Vol. 55, Issue 11
Seasonal Hydropower Planning for Data‐Scarce Regions Using Multimodel Ensemble Forecasts, Remote Sensing Data, and Stochastic Programming
journal, November 2019
- Koppa, Akash; Gebremichael, Mekonnen; Zambon, Renato C.
- Water Resources Research, Vol. 55, Issue 11
The Value of Subseasonal Hydrometeorological Forecasts to Hydropower Operations: How Much Does Preprocessing Matter?
journal, December 2019
- Anghileri, D.; Monhart, S.; Zhou, C.
- Water Resources Research, Vol. 55, Issue 12
Spatio-temporal changes and their relationship in water resources and agricultural disasters across China
journal, March 2019
- Gu, Xihui; Bai, Wenkui; Li, Jianfeng
- Hydrological Sciences Journal, Vol. 64, Issue 4
Can seasonal hydrological forecasts inform local decisions and actions? A decision-making activity
journal, January 2018
- Neumann, Jessica L.; Arnal, Louise; Emerton, Rebecca E.
- Geoscience Communication, Vol. 1, Issue 1
Assessment of an ensemble seasonal streamflow forecasting system for Australia
journal, January 2017
- Bennett, James C.; Wang, Quan J.; Robertson, David E.
- Hydrology and Earth System Sciences, Vol. 21, Issue 12
Skilful seasonal forecasts of streamflow over Europe?
journal, January 2018
- Arnal, Louise; Cloke, Hannah L.; Stephens, Elisabeth
- Hydrology and Earth System Sciences, Vol. 22, Issue 4
Evaluating post-processing approaches for monthly and seasonal streamflow forecasts
journal, January 2018
- Woldemeskel, Fitsum; McInerney, David; Lerat, Julien
- Hydrology and Earth System Sciences, Vol. 22, Issue 12
Spatio-temporal changes and their relationship in water resources and agricultural disasters across China
text, January 2019
- Gu, Xihui; Bai, Wenkui; Li, Jianfeng
- Taylor & Francis
Spatio-temporal changes and their relationship in water resources and agricultural disasters across China
text, January 2019
- Gu, Xihui; Bai, Wenkui; Li, Jianfeng
- Taylor & Francis