Search Menu
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information
Search Scholarly Publications

Title: Data processing and quality verification for improved photovoltaic performance and reliability analytics

Abstract

Data integrity is crucial for the performance and reliability analysis of photovoltaic (PV) systems, since actual in-field measurements commonly exhibit invalid data caused by outages and component failures. The scope of this paper is to present a complete methodology for PV data processing and quality verification in order to ensure improved PV performance and reliability analyses. Data quality routines (DQRs) were developed to ensure data fidelity by detecting and reconstructing invalid data through a sequence of filtering stages and inference techniques. The obtained results verified that PV performance and reliability analyses are sensitive to the fidelity of data and, therefore, time series reconstruction should be handled appropriately. To mitigate the bias effects of 10% or less invalid data, the listwise deletion technique provided accurate results for performance analytics (exhibited a maximum absolute percentage error of 0.92%). When missing data rates exceed 10%, data inference techniques yield more accurate results. The evaluation of missing power measurements demonstrated that time series reconstruction by applying the Sandia PV Array Performance Model yielded the lowest error among the investigated data inference techniques for PV performance analysis, with an absolute percentage error less than 0.71%, even at 40% missing data rate levels. The verification ofmore » the routines was performed on historical datasets from two different locations (desert and steppe climates). The proposed methodology provides a set of standardized analytical procedures to ensure the validity of performance and reliability evaluations that are performed over the lifetime of PV systems.« less

Authors:
ORCiD logo [1]; ORCiD logo [2];  [3]; ORCiD logo [1];  [1];  [4]; ORCiD logo [2]; ORCiD logo [1]
+ Show Author Affiliations
  1. PV Technology Laboratory, FOSS Research Centre for Sustainable Energy, Department of Electrical and Computer Engineering University of Cyprus Nicosia 1678 Cyprus
  2. Sandia National Laboratories Albuquerque NM 87185 USA
  3. SolarCentury 90 Union Street London SE1 0NW UK
  4. Gantner Instruments GmbH Montafonerstraße 4 Schruns 6780 Austria
Publication Date:
Research Org.:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org.:
European Regional Development Fund (ERDF); Cyprus Research & Innovation Foundation; USDOE Office of Energy Efficiency and Renewable Energy (EERE), Renewable Power Office. Solar Energy Technologies Office; USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1670826
Alternate Identifier(s):
OSTI ID: 1691440; OSTI ID: 1779979
Report Number(s):
SAND-2020-10988J
Journal ID: ISSN 1062-7995
Grant/Contract Number:  
AC04-94AL85000; P2P/SOLAR/0818/0012; 34364; NA0003525
Resource Type:
Published Article
Journal Name:
Progress in Photovoltaics
Additional Journal Information:
Journal Name: Progress in Photovoltaics; Journal ID: ISSN 1062-7995
Publisher:
Wiley
Country of Publication:
United Kingdom
Language:
English
Subject:
14 SOLAR ENERGY; analytics; data fidelity; data inference; data quality; invalid values; performance; photovoltaics

Citation Formats

Livera, Andreas, Theristis, Marios, Koumpli, Elena, Theocharides, Spyros, Makrides, George, Sutterlueti, Juergen, Stein, Joshua S., and Georghiou, George E. Data processing and quality verification for improved photovoltaic performance and reliability analytics. United Kingdom: N. p., 2020. Web. doi:10.1002/pip.3349.
Copy to clipboard
Livera, Andreas, Theristis, Marios, Koumpli, Elena, Theocharides, Spyros, Makrides, George, Sutterlueti, Juergen, Stein, Joshua S., & Georghiou, George E. Data processing and quality verification for improved photovoltaic performance and reliability analytics. United Kingdom. https://doi.org/10.1002/pip.3349
Copy to clipboard
Livera, Andreas, Theristis, Marios, Koumpli, Elena, Theocharides, Spyros, Makrides, George, Sutterlueti, Juergen, Stein, Joshua S., and Georghiou, George E. Wed . "Data processing and quality verification for improved photovoltaic performance and reliability analytics". United Kingdom. https://doi.org/10.1002/pip.3349.
Copy to clipboard
@article{osti_1670826,
title = {Data processing and quality verification for improved photovoltaic performance and reliability analytics},
author = {Livera, Andreas and Theristis, Marios and Koumpli, Elena and Theocharides, Spyros and Makrides, George and Sutterlueti, Juergen and Stein, Joshua S. and Georghiou, George E.},
abstractNote = {Data integrity is crucial for the performance and reliability analysis of photovoltaic (PV) systems, since actual in-field measurements commonly exhibit invalid data caused by outages and component failures. The scope of this paper is to present a complete methodology for PV data processing and quality verification in order to ensure improved PV performance and reliability analyses. Data quality routines (DQRs) were developed to ensure data fidelity by detecting and reconstructing invalid data through a sequence of filtering stages and inference techniques. The obtained results verified that PV performance and reliability analyses are sensitive to the fidelity of data and, therefore, time series reconstruction should be handled appropriately. To mitigate the bias effects of 10% or less invalid data, the listwise deletion technique provided accurate results for performance analytics (exhibited a maximum absolute percentage error of 0.92%). When missing data rates exceed 10%, data inference techniques yield more accurate results. The evaluation of missing power measurements demonstrated that time series reconstruction by applying the Sandia PV Array Performance Model yielded the lowest error among the investigated data inference techniques for PV performance analysis, with an absolute percentage error less than 0.71%, even at 40% missing data rate levels. The verification of the routines was performed on historical datasets from two different locations (desert and steppe climates). The proposed methodology provides a set of standardized analytical procedures to ensure the validity of performance and reliability evaluations that are performed over the lifetime of PV systems.},
doi = {10.1002/pip.3349},
journal = {Progress in Photovoltaics},
number = ,
volume = ,
place = {United Kingdom},
year = {2020},
month = {10}
}
Copy to clipboard
Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1002/pip.3349
Copyright Statement
Other availability
Search WorldCat Search WorldCat to find libraries that may hold this journal
Save / Share:
Export Metadata
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.

Works referenced in this record:

Inference of missing data in photovoltaic monitoring datasets
journal, April 2016

  • Gottschalg, Ralph; Rowley, Paul; Palmer, Diane
  • IET Renewable Power Generation, Vol. 10, Issue 4
  • DOI: 10.1049/iet-rpg.2015.0355

Missing Data Imputation of Solar Radiation Data under Different Atmospheric Conditions
journal, October 2014

  • Turrado, Concepción; López, María; Lasheras, Fernando
  • Sensors, Vol. 14, Issue 11
  • DOI: 10.3390/s141120382

Five-year performance and reliability analysis of monocrystalline photovoltaic modules with different backsheet materials
journal, September 2018

An analysis of four missing data treatment methods for supervised learning
journal, May 2003

  • Batista, Gustavo E. A. P. A.; Monard, Maria Carolina
  • Applied Artificial Intelligence, Vol. 17, Issue 5-6
  • DOI: 10.1080/713827181

Online Fault Detection in PV Systems
journal, October 2015

  • Platon, Radu; Martel, Jacques; Woodruff, Norris
  • IEEE Transactions on Sustainable Energy, Vol. 6, Issue 4
  • DOI: 10.1109/TSTE.2015.2421447

Comparison of Degradation Rates of Individual Modules Held at Maximum Power
conference, May 2006

  • Osterwald, C. R.; Adelstein, J.; del Cueto, J. A.
  • Conference Record of the 2006 IEEE 4th World Conference on Photovoltaic Energy Conversion, 2006 IEEE 4th World Conference on Photovoltaic Energy Conference
  • DOI: 10.1109/WCPEC.2006.279914

Nonlinear Photovoltaic Degradation Rates: Modeling and Comparison Against Conventional Methods
journal, July 2020

Missing Data in Educational Research: A Review of Reporting Practices and Suggestions for Improvement
journal, December 2004

Recent advances in failure diagnosis techniques based on performance data analysis for grid-connected photovoltaic systems
journal, April 2019

Transient Weighted Moving-Average Model of Photovoltaic Module Back-Surface Temperature
journal, July 2020

Missing value imputation for short to mid-term horizontal solar irradiance data
journal, September 2018

Modeling nonlinear photovoltaic degradation rates
conference, June 2020

  • Theristis, Marios; Livera, Andreas; Micheli, Leonardo
  • 2020 IEEE 47th Photovoltaic Specialists Conference (PVSC), 2020 47th IEEE Photovoltaic Specialists Conference (PVSC)
  • DOI: 10.1109/PVSC45281.2020.9300388

Methodology of Köppen-Geiger-Photovoltaic climate classification and implications to worldwide mapping of PV system performance
journal, October 2019

A power-rating model for crystalline silicon PV modules
journal, December 2011

QCPV: A quality control algorithm for distributed photovoltaic array power output
journal, February 2017

pvlib python: a python package for modeling solar energy systems
journal, September 2018

  • F. Holmgren, William; W. Hansen, Clifford; A. Mikofski, Mark
  • Journal of Open Source Software, Vol. 3, Issue 29
  • DOI: 10.21105/joss.00884

On the choice of the best imputation methods for missing values considering three groups of classification methods
journal, June 2011

  • Luengo, Julián; García, Salvador; Herrera, Francisco
  • Knowledge and Information Systems, Vol. 32, Issue 1
  • DOI: 10.1007/s10115-011-0424-2

Fault experiments in a commercial-scale PV laboratory and fault detection using local outlier factor
conference, June 2014

  • Zhao, Ye; Balboni, Florent; Arnaud, Thierry
  • 2014 IEEE 40th Photovoltaic Specialists Conference (PVSC), 2014 IEEE 40th Photovoltaic Specialist Conference (PVSC)
  • DOI: 10.1109/PVSC.2014.6925661

Automated performance monitoring for PV systems using pecos
conference, June 2016

  • Klise, Katherine A.; Stein, Joshua S.
  • 2016 IEEE 43rd Photovoltaic Specialists Conference (PVSC)
  • DOI: 10.1109/PVSC.2016.7750304

PV degradation curves: non-linearities and failure modes: PV degradation curves: non-linearities and failure modes
journal, September 2016

  • Jordan, Dirk C.; Silverman, Timothy J.; Sekulic, Bill
  • Progress in Photovoltaics: Research and Applications, Vol. 25, Issue 7
  • DOI: 10.1002/pip.2835

Review of photovoltaic degradation rate methodologies
journal, December 2014

  • Phinikarides, Alexander; Kindyni, Nitsa; Makrides, George
  • Renewable and Sustainable Energy Reviews, Vol. 40
  • DOI: 10.1016/j.rser.2014.07.155

Quality of performance assessment of PV plants based on irradiation maps
journal, November 2008

mice : Multivariate Imputation by Chained Equations in R
journal, January 2011

  • Buuren, Stef van; Groothuis-Oudshoorn, Karin
  • Journal of Statistical Software, Vol. 45, Issue 3
  • DOI: 10.18637/jss.v045.i03

Robust PV Degradation Methodology and Application
journal, March 2018

    Sort by:
    [ × clear filter / sort ]

    Similar Records in DOE PAGES and OSTI.GOV collections: