Generation and validation of comprehensive synthetic weather histories using auto-regressive moving-average models

Rigby, Aidan; Baker, Una; Lindley, Benjamin; Wagner, Michael

doi:10.1016/j.renene.2024.120157

Title: Generation and validation of comprehensive synthetic weather histories using auto-regressive moving-average models

Journal Article · 14 February 2024 · Renewable Energy

DOI: https://doi.org/10.1016/j.renene.2024.120157 · OSTI ID:2319233

^[1];

^[2];

^[2]

University of Wisconsin-Madison, WI (United States); University of Wisconsin-Madison Department of Mechanical Engineering
University of Wisconsin-Madison, WI (United States)

As energy system design moves to more complex methods of optimization including machine learning there is a significant need for more weather data than is available. One method to solve this is using synthetic data models such as the auto-regressive moving-average (ARMA) model which has been frequently utilized to create such data. This paper looks at extending the ARMA algorithm to generate solar components through the use of clearsky detrending, maintaining vector relationships and by leveraging physical relationships. The method for the creation of entirely synthetic weather data files including key weather variables for energy system analysis is presented. Furthermore, a detailed comparison of energy system simulations utilizing both real and synthetic data is made using NREL’s System Advisor Model. Whilst good agreement is made for the solar variables, and other weather variables, ARMA methods often fail to capture the standard deviation and skew of annual weather distributions. Vector-ARMA is shown to maintain correlations between variables and thus generate data sets that perform similarly in energy system design. Here, it is finally shown that the ARMA method fails to preserve day-today correlations in weather variables and thus over-predicts optimal energy storage by 21% for a residential solar application.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: University of Wisconsin-Madison, WI (United States)

Sponsoring Organization:: USDOE Office of Nuclear Energy (NE)

Grant/Contract Number:: NE0008988

OSTI ID:: 2319233

Alternate ID(s):: OSTI ID: 2369683

Journal Information:: Renewable Energy, Journal Name: Renewable Energy Vol. 224; ISSN 0960-1481

Publisher:: ElsevierCopyright Statement

Country of Publication:: United States

Language:: English

References (50)

The National Solar Radiation Data Base (NSRDB) Sengupta, Manajit; Xie, Yu; Lopez, Anthony Renewable and Sustainable Energy Reviews, Vol. 89 https://doi.org/10.1016/j.rser.2018.03.003	journal	June 2018
Synthetic generation of high temporal resolution solar radiation data using Markov models Ngoko, B. O.; Sugihara, H.; Funaki, T. Solar Energy, Vol. 103 https://doi.org/10.1016/j.solener.2014.02.026	journal	May 2014
Artificial neural network estimation of global solar radiation using air temperature and relative humidity Rehman, Shafiqur; Mohandes, Mohamed Energy Policy, Vol. 36, Issue 2 https://doi.org/10.1016/j.enpol.2007.09.033	journal	February 2008
The Economics of Variable Renewable Energy and Electricity Storage López Prol, Javier; Schill, Wolf-Peter Annual Review of Resource Economics, Vol. 13, Issue 1 https://doi.org/10.1146/annurev-resource-101620-081246	journal	October 2021
Generating synthetic sequences of global horizontal irradiation Grantham, A. P.; Pudney, P. J.; Boland, J. W. Solar Energy, Vol. 162 https://doi.org/10.1016/j.solener.2018.01.044	journal	March 2018
Generating synthetic five-minute solar irradiance values from hourly observations Grantham, A. P.; Pudney, P. J.; Ward, L. A. Solar Energy, Vol. 147 https://doi.org/10.1016/j.solener.2017.03.026	journal	May 2017
The Importance of Combined Cycle Generating Plants in Integrating Large Levels of Wind Power Generation Puga, J. Nicolas The Electricity Journal, Vol. 23, Issue 7 https://doi.org/10.1016/j.tej.2010.07.002	journal	August 2010
Analysis of the performances of the first-order two-state Markov model using solar radiation properties Maafi, A.; Adane, A. Renewable Energy, Vol. 13, Issue 2 https://doi.org/10.1016/S0960-1481(97)00094-3	journal	February 1998
A methodology for the stochastic generation of hourly synthetic direct normal irradiation time series Larrañeta, M.; Moreno-Tejera, S.; Lillo-Bravo, I. Theoretical and Applied Climatology, Vol. 131, Issue 3-4 https://doi.org/10.1007/s00704-017-2188-4	journal	June 2017
Prediction of hourly solar radiation using a novel hybrid model of ARMA and TDNN Ji, Wu; Chee, Keong Chan Solar Energy, Vol. 85, Issue 5 https://doi.org/10.1016/j.solener.2011.01.013	journal	May 2011
Univariate and multivariate forecasting of hourly solar radiation with artificial intelligence techniques Sfetsos, A.; Coonick, A. H. Solar Energy, Vol. 68, Issue 2 https://doi.org/10.1016/S0038-092X(99)00064-X	journal	February 2000
Correlated synthetic time series generation for energy system simulations using Fourier and ARMA signal processing Talbot, Paul W.; Rabiti, Cristian; Alfonsi, Andrea International Journal of Energy Research, Vol. 44, Issue 10 https://doi.org/10.1002/er.5115	journal	March 2020
The level of complexity needed for weather data in models of solar system performance Boland, John; Dik, Marjolijn Solar Energy, Vol. 71, Issue 3 https://doi.org/10.1016/S0038-092X(01)00040-8	journal	January 2001
Global zero-carbon energy pathways using viable mixes of nuclear and renewables Hong, Sanghyun; Bradshaw, Corey J. A.; Brook, Barry W. Applied Energy, Vol. 143 https://doi.org/10.1016/j.apenergy.2015.01.006	journal	April 2015
Can the world run on renewable energy? A revised negative case Trainer, Ted Humanomics, Vol. 29, Issue 2 https://doi.org/10.1108/08288661311319166	journal	May 2013
A Hybrid Artificial Intelligence and Internet of Things Model for Generation of Renewable Resource of Energy Puri, Vikram; Jha, Sudan; Kumar, Raghvendra IEEE Access, Vol. 7 https://doi.org/10.1109/ACCESS.2019.2934228	journal	January 2019
Forecasting Turkey's tourism revenues by ARMAX model Akal, Mustafa Tourism Management, Vol. 25, Issue 5 https://doi.org/10.1016/j.tourman.2003.08.001	journal	October 2004
Forecasting of global and direct solar irradiance using stochastic learning methods, ground experiments and the NWS database Marquez, Ricardo; Coimbra, Carlos F. M. Solar Energy, Vol. 85, Issue 5 https://doi.org/10.1016/j.solener.2011.01.007	journal	May 2011
A stochastic solar irradiance model adjusted on the Ångström–Prescott regression Morf, Heinrich Solar Energy, Vol. 87 https://doi.org/10.1016/j.solener.2012.10.005	journal	January 2013
An ANN-based approach for predicting global radiation in locations with no direct measurement instrumentation Al-Alawi, S. M.; Al-Hinai, H. A. Renewable Energy, Vol. 14, Issue 1-4 https://doi.org/10.1016/S0960-1481(98)00068-8	journal	May 1998
Assessment of Deep Learning techniques for Prognosis of solar thermal systems Correa-Jullian, Camila; Cardemil, José Miguel; López Droguett, Enrique Renewable Energy, Vol. 145 https://doi.org/10.1016/j.renene.2019.07.100	journal	January 2020
Mapping of the Solar Irradiance in the UAE Using Advanced Artificial Neural Network Ensemble Alobaidi, Mohammad H.; Marpu, Prashanth R.; Ouarda, Taha B. M. J. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 7, Issue 8 https://doi.org/10.1109/JSTARS.2014.2331255	journal	August 2014
Isolating cloud induced noise to improve generation of synthetic surface solar irradiances Flanagan, Rr; Talbot, P.; Osborne, Ag Advances in Applied Energy, Vol. 3 https://doi.org/10.1016/j.adapen.2021.100045	journal	August 2021
Stochastic generation of synthetic minutely irradiance time series derived from mean hourly weather observation data Bright, J. M.; Smith, C. J.; Taylor, P. G. Solar Energy, Vol. 115 https://doi.org/10.1016/j.solener.2015.02.032	journal	May 2015
Generation of synthetic sequences of electricity demand: Application in South Australia Magnano, L.; Boland, J. Energy, Vol. 32, Issue 11 https://doi.org/10.1016/j.energy.2007.04.001	journal	November 2007
Economic Dispatch Model of Nuclear High-Temperature Reactor with Hydrogen Cogeneration in Electricity Market Richards, James; Rabiti, Cristian; Sato, Hiroyuki Energies, Vol. 14, Issue 24 https://doi.org/10.3390/en14248289	journal	December 2021
Energy Storage and Its Use With Intermittent Renewable Energy Barton, J. P.; Infield, D. G. IEEE Transactions on Energy Conversion, Vol. 19, Issue 2 https://doi.org/10.1109/TEC.2003.822305	journal	June 2004
Artificial intelligence in sustainable energy industry: Status Quo, challenges and opportunities Ahmad, Tanveer; Zhang, Dongdong; Huang, Chao Journal of Cleaner Production, Vol. 289 https://doi.org/10.1016/j.jclepro.2021.125834	journal	March 2021
ARMA based approaches for forecasting the tuple of wind speed and direction Erdem, Ergin; Shi, Jing Applied Energy, Vol. 88, Issue 4 https://doi.org/10.1016/j.apenergy.2010.10.031	journal	April 2011
MUS: A multiscale stochastic model for generating plausible meteorological years designed for multiyear solar energy yield simulations Fernández-Peruchena, Carlos M.; Gastón, Martín; Sánchez, Marcelino Solar Energy, Vol. 120 https://doi.org/10.1016/j.solener.2015.07.037	journal	October 2015
How effective are neural networks at forecasting and prediction? A review and evaluation Adya, Monica; Collopy, Fred Journal of Forecasting, Vol. 17, Issue 5-6 https://doi.org/10.1002/(SICI)1099-131X(1998090)17:5/6<481::AID-FOR709>3.0.CO;2-Q	journal	September 1998
Characterization and simulation of hourly exposure series of global radiation Mora-López, Ll.; Sidrach-De-Cardona, M. Solar Energy, Vol. 60, Issue 5 https://doi.org/10.1016/S0038-092X(97)00018-2	journal	June 1997
A Hybrid Model for Day-Ahead Price Forecasting IEEE Transactions on Power Systems, Vol. 25, Issue 3 https://doi.org/10.1109/TPWRS.2009.2039948	journal	August 2010
Optimal scheduling of demand responsive industrial production with hybrid renewable energy systems Wang, Xiaonan; El-Farra, Nael H.; Palazoglu, Ahmet Renewable Energy, Vol. 100 https://doi.org/10.1016/j.renene.2016.05.051	journal	January 2017
A new airmass independent formulation for the Linke turbidity coefficient Ineichen, Pierre; Perez, Richard Solar Energy, Vol. 73, Issue 3 https://doi.org/10.1016/S0038-092X(02)00045-2	journal	September 2002
Solar radiation estimation using artificial neural networks Dorvlo, Atsu S. S.; Jervase, Joseph A.; Al-Lawati, Ali Applied Energy, Vol. 71, Issue 4 https://doi.org/10.1016/S0306-2619(02)00016-8	journal	April 2002
A methodology for the synthesis of hourly weather data Knight, K. M.; Klein, S. A.; Duffie, J. A. Solar Energy, Vol. 46, Issue 2 https://doi.org/10.1016/0038-092X(91)90023-P	journal	January 1991
Comparison of the ARMA, ARIMA, and the autoregressive artificial neural network models in forecasting the monthly inflow of Dez dam reservoir Valipour, Mohammad; Banihabib, Mohammad Ebrahim; Behbahani, Seyyed Mahmood Reza Journal of Hydrology, Vol. 476 https://doi.org/10.1016/j.jhydrol.2012.11.017	journal	January 2013
Simple procedure for generating sequences of daily radiation values using a library of Markov transition matrices Aguiar, R. J.; Collares-Pereira, M.; Conde, J. P. Solar Energy, Vol. 40, Issue 3 https://doi.org/10.1016/0038-092X(88)90049-7	journal	January 1988
Synthetic wind speed scenarios generation for probabilistic analysis of hybrid energy systems Chen, Jun; Rabiti, Cristian Energy, Vol. 120 https://doi.org/10.1016/j.energy.2016.11.103	journal	February 2017
On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other Mann, H. B.; Whitney, D. R. The Annals of Mathematical Statistics, Vol. 18, Issue 1 https://doi.org/10.1214/aoms/1177730491	journal	March 1947
Forecast of hourly average wind speed with ARMA models in Navarre (Spain) Torres, J. L.; García, A.; De Blas, M. Solar Energy, Vol. 79, Issue 1 https://doi.org/10.1016/j.solener.2004.09.013	journal	July 2005
Time series models to simulate and forecast hourly averaged wind speed in Quetta, Pakistan Kamal, Lalarukh; Jafri, Yasmin Zahra Solar Energy, Vol. 61, Issue 1 https://doi.org/10.1016/S0038-092X(97)00037-6	journal	July 1997
Multiplicative ARMA models to generate hourly series of global irradiation Mora-López, Ll.; Sidrach-de-Cardona, M. Solar Energy, Vol. 63, Issue 5 https://doi.org/10.1016/S0038-092X(98)00078-4	journal	November 1998
Synthesis of hourly wind power series using the Moving Block Bootstrap method Usaola, Julio 2014 International Conference on Probabilistic Methods Applied to Power Systems (PMAPS) https://doi.org/10.1109/PMAPS.2014.6960602	conference	July 2014
Probabilistic modeling of a parabolic trough collector power plant – An uncertainty and sensitivity analysis Zaversky, Fritz; García-Barberena, Javier; Sánchez, Marcelino Solar Energy, Vol. 86, Issue 7 https://doi.org/10.1016/j.solener.2012.04.015	journal	July 2012
An improved model for the synthetic generation of high temporal resolution direct normal irradiation time series Larrañeta, M.; Moreno-Tejera, S.; Silva-Pérez, M. A. Solar Energy, Vol. 122 https://doi.org/10.1016/j.solener.2015.09.030	journal	December 2015
Impact assessment of renewable generation on electricity demand characteristics Chaiamarit, Kunjana; Nuchprayoon, Somboon Renewable and Sustainable Energy Reviews, Vol. 39 https://doi.org/10.1016/j.rser.2014.07.102	journal	November 2014
Incorporating Uncertainty into Probabilistic Performance Models of Concentrating Solar Power Plants Ho, Clifford K.; Kolb, Gregory J. Journal of Solar Energy Engineering, Vol. 132, Issue 3 https://doi.org/10.1115/1.4001468	journal	June 2010
Neural Networks for Forecasting: An Introduction Kohzadi, Nowrouz; Boyd, Milton S.; Kaastra, Iebeling Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Vol. 43, Issue 3 https://doi.org/10.1111/j.1744-7976.1995.tb00135.x	journal	November 1995

Similar Records

Correlated Synthetic Time Series Generation using Fourier and ARMA

Conference · 2019 · OSTI ID:1634101

Talbot, Paul W; Rabiti, Cristian; Alfonsi, Andrea; +5 more

Grid-Integrated Production of Fischer-Tropsch Synfuels from Nuclear Power

Technical Report · 2023 · OSTI ID:1984196

Garrouste, Marisol; Wendt, Daniel S.; Jenson, William Dunkley; +3 more

Analysis of Differential Financial Impacts of LWR Load-Following Operations. Revision 1

Technical Report · 2019 · OSTI ID:1569226

Talbot, Paul W.; Burli, Pralhad Hanumant; Richardson, James D.; +3 more

Related Subjects

42
Synthetic data generation
Auto-regressive moving-average
Concentrated solar power
Renewable energy
Integrated energy systems

Title: Generation and validation of comprehensive synthetic weather histories using auto-regressive moving-average models

Citation Formats

References (50)

Similar Records

Related Subjects