DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Day-ahead photovoltaic power production forecasting methodology based on machine learning and statistical post-processing

Abstract

A main challenge towards ensuring large-scale and seamless integration of photovoltaic systems is to improve the accuracy of energy yield forecasts, especially in grid areas of high photovoltaic shares. The scope of this paper is to address this issue by presenting a unified methodology for hourly-averaged day-ahead photovoltaic power forecasts with improved accuracy, based on data-driven machine learning techniques and statistical post-processing. More specifically, the proposed forecasting methodology framework comprised of a data quality stage, data-driven power output machine learning model development (artificial neural networks), weather clustering assessment (K-means clustering), post-processing output optimisation (linear regressive correction method) and the final performance accuracy evaluation. The results showed that the application of linear regression coefficients to the forecasted outputs of the developed day-ahead photovoltaic power production neural network improved the performance accuracy by further correcting solar irradiance forecasting biases. The resulting optimised model provided a mean absolute percentage error of 4.7% when applied to historical system datasets. Finally, the model was validated both, at a hot as well as a cold semi-arid climatic location, and the obtained results demonstrated close agreement by yielding forecasting accuracies of mean absolute percentage error of 4.7% and 6.3%, respectively. Finally, the validation analysis provides evidence thatmore » the proposed model exhibits high performance in both forecasting accuracy and stability.« less

Authors:
 [1];  [1];  [1];  [2];  [3];  [1]
  1. Univ. of Cyprus, Nicosia (Cyprus)
  2. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
  3. Univ. of Central Lancashire Cyprus, Pyla (Cyprus)
Publication Date:
Research Org.:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA); European Union (EU)
OSTI Identifier:
1617300
Report Number(s):
SAND-2020-4201J
Journal ID: ISSN 0306-2619; 685417
Grant/Contract Number:  
AC04-94AL85000; SOLAR-ERA.NETT/1215/02; NA0003525
Resource Type:
Accepted Manuscript
Journal Name:
Applied Energy
Additional Journal Information:
Journal Volume: 268; Journal Issue: C; Journal ID: ISSN 0306-2619
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
42 ENGINEERING; artificial neural networks; clustering; forecasting; machine learning; photovoltaic; performance

Citation Formats

Theocharides, Spyros, Makrides, George, Livera, Andreas, Theristis, Marios, Kaimakis, Paris, and Georghiou, George E. Day-ahead photovoltaic power production forecasting methodology based on machine learning and statistical post-processing. United States: N. p., 2020. Web. doi:10.1016/j.apenergy.2020.115023.
Theocharides, Spyros, Makrides, George, Livera, Andreas, Theristis, Marios, Kaimakis, Paris, & Georghiou, George E. Day-ahead photovoltaic power production forecasting methodology based on machine learning and statistical post-processing. United States. https://doi.org/10.1016/j.apenergy.2020.115023
Theocharides, Spyros, Makrides, George, Livera, Andreas, Theristis, Marios, Kaimakis, Paris, and Georghiou, George E. Tue . "Day-ahead photovoltaic power production forecasting methodology based on machine learning and statistical post-processing". United States. https://doi.org/10.1016/j.apenergy.2020.115023. https://www.osti.gov/servlets/purl/1617300.
@article{osti_1617300,
title = {Day-ahead photovoltaic power production forecasting methodology based on machine learning and statistical post-processing},
author = {Theocharides, Spyros and Makrides, George and Livera, Andreas and Theristis, Marios and Kaimakis, Paris and Georghiou, George E.},
abstractNote = {A main challenge towards ensuring large-scale and seamless integration of photovoltaic systems is to improve the accuracy of energy yield forecasts, especially in grid areas of high photovoltaic shares. The scope of this paper is to address this issue by presenting a unified methodology for hourly-averaged day-ahead photovoltaic power forecasts with improved accuracy, based on data-driven machine learning techniques and statistical post-processing. More specifically, the proposed forecasting methodology framework comprised of a data quality stage, data-driven power output machine learning model development (artificial neural networks), weather clustering assessment (K-means clustering), post-processing output optimisation (linear regressive correction method) and the final performance accuracy evaluation. The results showed that the application of linear regression coefficients to the forecasted outputs of the developed day-ahead photovoltaic power production neural network improved the performance accuracy by further correcting solar irradiance forecasting biases. The resulting optimised model provided a mean absolute percentage error of 4.7% when applied to historical system datasets. Finally, the model was validated both, at a hot as well as a cold semi-arid climatic location, and the obtained results demonstrated close agreement by yielding forecasting accuracies of mean absolute percentage error of 4.7% and 6.3%, respectively. Finally, the validation analysis provides evidence that the proposed model exhibits high performance in both forecasting accuracy and stability.},
doi = {10.1016/j.apenergy.2020.115023},
journal = {Applied Energy},
number = C,
volume = 268,
place = {United States},
year = {Tue Apr 21 00:00:00 EDT 2020},
month = {Tue Apr 21 00:00:00 EDT 2020}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 85 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Voltage stability and sensitivity analysis of grid-connected photovoltaic systems
conference, July 2011

  • Xue, Yaosuo; Manjrekar, Madhav; Lin, Chenxi
  • 2011 IEEE Power & Energy Society General Meeting, 2011 IEEE Power and Energy Society General Meeting
  • DOI: 10.1109/PES.2011.6039649

Solar forecasting methods for renewable energy integration
journal, December 2013

  • Inman, Rich H.; Pedro, Hugo T. C.; Coimbra, Carlos F. M.
  • Progress in Energy and Combustion Science, Vol. 39, Issue 6
  • DOI: 10.1016/j.pecs.2013.06.002

Assessment of forecasting techniques for solar power production with no exogenous inputs
journal, July 2012


Solar Power Prediction Based on Satellite Images and Support Vector Machine
journal, July 2016

  • Jang, Han Seung; Bae, Kuk Yeol; Park, Hong-Shik
  • IEEE Transactions on Sustainable Energy, Vol. 7, Issue 3
  • DOI: 10.1109/TSTE.2016.2535466

Short-term solar forecasting based on sky images to enable higher PV generation in remote electricity networks
journal, January 2017

  • Schmidt, Thomas; Calais, Martina; Roy, Eric
  • Renewable Energy and Environmental Sustainability, Vol. 2
  • DOI: 10.1051/rees/2017028

Review of photovoltaic power forecasting
journal, October 2016


Online 24-h solar power forecasting based on weather type classification using artificial neural network
journal, November 2011


Forecasting Power Output of Photovoltaic Systems Based on Weather Classification and Support Vector Machines
journal, May 2012

  • Shi, Jie; Lee, Wei-Jen; Liu, Yongqian
  • IEEE Transactions on Industry Applications, Vol. 48, Issue 3
  • DOI: 10.1109/TIA.2012.2190816

A Weather-Based Hybrid Method for 1-Day Ahead Hourly Forecasting of PV Power Output
journal, July 2014

  • Yang, Hong-Tzer; Huang, Chao-Ming; Huang, Yann-Chang
  • IEEE Transactions on Sustainable Energy, Vol. 5, Issue 3
  • DOI: 10.1109/TSTE.2014.2313600

Solar and photovoltaic forecasting through post-processing of the Global Environmental Multiscale numerical weather prediction model: Solar and photovoltaic forecasting
journal, November 2011

  • Pelland, Sophie; Galanis, George; Kallos, George
  • Progress in Photovoltaics: Research and Applications, Vol. 21, Issue 3
  • DOI: 10.1002/pip.1180

PVWatts Version 5 Manual
report, September 2014


Prediction of short-term PV power output and uncertainty analysis
journal, October 2018


Photovoltaic system power forecasting based on combined grey model and BP neural network
conference, September 2011

  • Wang, Shouxiang; Zhang, Na; Zhao, Yishu
  • 2011 International Conference on Electrical and Control Engineering (ICECE)
  • DOI: 10.1109/ICECENG.2011.6057634

Short-term forecasting of power production in a large-scale photovoltaic plant
journal, July 2014


A Physical Hybrid Artificial Neural Network for Short Term Forecasting of PV Plant Power Output
journal, February 2015

  • Dolara, Alberto; Grimaccia, Francesco; Leva, Sonia
  • Energies, Vol. 8, Issue 2
  • DOI: 10.3390/en8021138

Day-Ahead Photovoltaic Forecasting: A Comparison of the Most Effective Techniques
journal, April 2019

  • Nespoli, Alfredo; Ogliari, Emanuele; Leva, Sonia
  • Energies, Vol. 12, Issue 9
  • DOI: 10.3390/en12091621

Accurate photovoltaic power forecasting models using deep LSTM-RNN
journal, October 2017


Pearson's correlation coefficient
journal, July 2012


Machine learning algorithms for photovoltaic system power output prediction
conference, June 2018

  • Theocharides, Spyros; Makrides, George; Georghiou, George E.
  • 2018 IEEE International Energy Conference (ENERGYCON)
  • DOI: 10.1109/ENERGYCON.2018.8398737

Learning representations by back-propagating errors
journal, October 1986

  • Rumelhart, David E.; Hinton, Geoffrey E.; Williams, Ronald J.
  • Nature, Vol. 323, Issue 6088
  • DOI: 10.1038/323533a0

Bayesian Interpolation
journal, May 1992


Gauss-Newton approximation to Bayesian learning
conference, January 1997

  • Dan Foresee, F.; Hagan, M. T.
  • Proceedings of International Conference on Neural Networks (ICNN'97)
  • DOI: 10.1109/ICNN.1997.614194

Solar position algorithm for solar radiation applications
journal, January 2004


The Application of Cluster Analysis in Strategic Management Research: an Analysis and Critique
journal, June 1996


A New Sub-topics Clustering Method Based on Semi-supervised Learing
journal, October 2012


The Royal London Space Planning: An integration of space analysis and treatment planning
journal, October 2000

  • Kirschen, Robert H.; O'Higgins, Elizabeth A.; Lee, Robert T.
  • American Journal of Orthodontics and Dentofacial Orthopedics, Vol. 118, Issue 4
  • DOI: 10.1067/mod.2000.109031

Making data structures persistent
journal, February 1989

  • Driscoll, James R.; Sarnak, Neil; Sleator, Daniel D.
  • Journal of Computer and System Sciences, Vol. 38, Issue 1
  • DOI: 10.1016/0022-0000(89)90034-2

Another look at measures of forecast accuracy
journal, October 2006


Information-Based Skill Scores for Probabilistic Forecasts
journal, January 2008


Updated world map of the Köppen-Geiger climate classification
journal, January 2007

  • Peel, M. C.; Finlayson, B. L.; McMahon, T. A.
  • Hydrology and Earth System Sciences, Vol. 11, Issue 5
  • DOI: 10.5194/hess-11-1633-2007

Quality of performance assessment of PV plants based on irradiation maps
journal, November 2008


Energy yield prediction errors and uncertainties of different photovoltaic models: Energy yield prediction errors and uncertainties
journal, November 2011

  • Makrides, George; Zinsser, Bastian; Schubert, Markus
  • Progress in Photovoltaics: Research and Applications, Vol. 21, Issue 4
  • DOI: 10.1002/pip.1218

Potential of photovoltaic systems in countries with high solar irradiation
journal, February 2010

  • Makrides, George; Zinsser, Bastian; Norton, Matthew
  • Renewable and Sustainable Energy Reviews, Vol. 14, Issue 2
  • DOI: 10.1016/j.rser.2009.07.021

Numerical weather prediction
journal, December 2002


The origins of computer weather prediction and climate modeling
journal, March 2008


A forecast error correction method in numerical weather prediction by using recent multiple-time evolution data
journal, August 2013

  • Xue, Hai-Le; Shen, Xue-Shun; Chou, Ji-Fan
  • Advances in Atmospheric Sciences, Vol. 30, Issue 5
  • DOI: 10.1007/s00376-013-2274-1

The Solar Forecast Arbiter: An Open Source Evaluation Framework for Solar Forecasting
conference, June 2019

  • Hansen, Clifford W.; Holmgren, William F.; Tuohy, Aidan
  • 2019 IEEE 46th Photovoltaic Specialists Conference (PVSC)
  • DOI: 10.1109/PVSC40753.2019.8980713

Early Stopping - But When?
book, January 1998


Summarizing multiple aspects of model performance in a single diagram
journal, April 2001

  • Taylor, Karl E.
  • Journal of Geophysical Research: Atmospheres, Vol. 106, Issue D7
  • DOI: 10.1029/2000JD900719