Automated construction of clear-sky dictionary from all-sky imager data
Abstract
All-sky imagers (ASIs) have significant promise as scalable sensors for short-term solar irradiance forecasting. Many of the current computational techniques that use ASIs for this purpose rely on collections of clear-sky images indexed by time of day, solar angle, or both, called clear-sky dictionaries (CSDs). These CSDs act as baselines against which images can be compared to locate and classify clouds within the image frame. CSDs are often compiled by hand, where individuals visually inspect collections of images one at a time to find clear-sky images. This process is not scalable, and it is prone to error. This paper proposes an automated, nonparametric alternative that uses the principles of digital image processing to find clear-sky images within a set of images taken over several days. We use ground-truth measurements of the clearness index to assess the performance of our method, and we show that the images it selects accurately correspond to clear-sky images. We also compare our proposal, which is nonparametric, with a state-of-the-art parametric method. The numerical results indicate that the performance of the method proposed here is superior.
- Authors:
-
- Univ. of Colorado, Boulder, CO (United States)
- National Renewable Energy Lab. (NREL), Golden, CO (United States)
- Publication Date:
- Research Org.:
- National Renewable Energy Lab. (NREL), Golden, CO (United States)
- Sponsoring Org.:
- USDOE Office of Electricity (OE); USDOE Office of Energy Efficiency and Renewable Energy (EERE), Renewable Power Office. Solar Energy Technologies Office
- OSTI Identifier:
- 1755700
- Alternate Identifier(s):
- OSTI ID: 1810965
- Report Number(s):
- NREL/JA-5D00-76692
Journal ID: ISSN 0038-092X; MainId:9353;UUID:a8a5cb5e-101f-4d68-a49a-e35badba4fcf;MainAdminID:19010
- Grant/Contract Number:
- AC36-08GO28308
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Solar Energy
- Additional Journal Information:
- Journal Volume: 212; Journal ID: ISSN 0038-092X
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 14 SOLAR ENERGY; all-sky imager; clear-sky dictionary; cloud detection; digital image processing; red-to-blue ratio; short-term solar irradiance forecasting
Citation Formats
Shaffery, Peter, Habte, Aron, Netto, Marcos, Andreas, Afshin, and Krishnan, Venkat. Automated construction of clear-sky dictionary from all-sky imager data. United States: N. p., 2020.
Web. doi:10.1016/j.solener.2020.10.052.
Shaffery, Peter, Habte, Aron, Netto, Marcos, Andreas, Afshin, & Krishnan, Venkat. Automated construction of clear-sky dictionary from all-sky imager data. United States. https://doi.org/10.1016/j.solener.2020.10.052
Shaffery, Peter, Habte, Aron, Netto, Marcos, Andreas, Afshin, and Krishnan, Venkat. Tue .
"Automated construction of clear-sky dictionary from all-sky imager data". United States. https://doi.org/10.1016/j.solener.2020.10.052. https://www.osti.gov/servlets/purl/1755700.
@article{osti_1755700,
title = {Automated construction of clear-sky dictionary from all-sky imager data},
author = {Shaffery, Peter and Habte, Aron and Netto, Marcos and Andreas, Afshin and Krishnan, Venkat},
abstractNote = {All-sky imagers (ASIs) have significant promise as scalable sensors for short-term solar irradiance forecasting. Many of the current computational techniques that use ASIs for this purpose rely on collections of clear-sky images indexed by time of day, solar angle, or both, called clear-sky dictionaries (CSDs). These CSDs act as baselines against which images can be compared to locate and classify clouds within the image frame. CSDs are often compiled by hand, where individuals visually inspect collections of images one at a time to find clear-sky images. This process is not scalable, and it is prone to error. This paper proposes an automated, nonparametric alternative that uses the principles of digital image processing to find clear-sky images within a set of images taken over several days. We use ground-truth measurements of the clearness index to assess the performance of our method, and we show that the images it selects accurately correspond to clear-sky images. We also compare our proposal, which is nonparametric, with a state-of-the-art parametric method. The numerical results indicate that the performance of the method proposed here is superior.},
doi = {10.1016/j.solener.2020.10.052},
journal = {Solar Energy},
number = ,
volume = 212,
place = {United States},
year = {Tue Nov 10 00:00:00 EST 2020},
month = {Tue Nov 10 00:00:00 EST 2020}
}
Works referenced in this record:
The clear-sky index to separate clear-sky from cloudy-sky situations in climate research
journal, September 2000
- Marty, Christoph; Philipona, Rolf
- Geophysical Research Letters, Vol. 27, Issue 17
A reevaluation of the solar constant based on a 42-year total solar irradiance time series and a reconciliation of spaceborne observations
journal, July 2018
- Gueymard, Christian A.
- Solar Energy, Vol. 168
Cloud base height estimates from sky imagery and a network of pyranometers
journal, May 2019
- Wang, Guang Chao; Urquhart, Bryan; Kleissl, Jan
- Solar Energy, Vol. 184
Local estimation of the global horizontal irradiance using an all-sky camera
journal, October 2018
- Scolari, Enrica; Sossan, Fabrizio; Haure-Touzé, Mathia
- Solar Energy, Vol. 173
Rough-Set-Based Color Channel Selection
journal, January 2017
- Dev, Soumyabrata; Savoy, Florian M.; Lee, Yee Hui
- IEEE Geoscience and Remote Sensing Letters, Vol. 14, Issue 1
History and trends in solar irradiance and PV power forecasting: A preliminary assessment and review using text mining
journal, July 2018
- Yang, Dazhi; Kleissl, Jan; Gueymard, Christian A.
- Solar Energy, Vol. 168
Cloud Motion Identification Algorithms Based on All-Sky Images to Support Solar Irradiance Forecast
conference, June 2017
- Magnone, Lydie; Sossan, Fabrizio; Scolari, Enrica
- 2017 IEEE 44th Photovoltaic Specialists Conference (PVSC), 2017 IEEE 44th Photovoltaic Specialist Conference (PVSC)
A Simple Method for the Assessment of the Cloud Cover State in High-Latitude Regions by a Ground-Based Digital Camera
journal, March 2006
- Souza-Echer, M. P.; Pereira, E. B.; Bins, L. S.
- Journal of Atmospheric and Oceanic Technology, Vol. 23, Issue 3
Intra-hour DNI forecasting based on cloud tracking image analysis
journal, May 2013
- Marquez, Ricardo; Coimbra, Carlos F. M.
- Solar Energy, Vol. 91, p. 327-336
Retrieving Cloud Characteristics from Ground-Based Daytime Color All-Sky Images
journal, May 2006
- Long, C. N.; Sabburg, J. M.; Calbó, J.
- Journal of Atmospheric and Oceanic Technology, Vol. 23, Issue 5
Validation of an all-sky imager-based nowcasting system for industrial PV plants
journal, November 2017
- Kuhn, Pascal; Nouri, Bijan; Wilbert, Stefan
- Progress in Photovoltaics: Research and Applications, Vol. 26, Issue 8
Worldwide performance assessment of 95 direct and diffuse clear-sky irradiance models using principal component analysis
journal, January 2021
- Sun, Xixi; Bright, Jamie M.; Gueymard, Christian A.
- Renewable and Sustainable Energy Reviews, Vol. 135
Feature Extraction from Whole-Sky Ground-Based Images for Cloud-Type Recognition
journal, January 2008
- Calbó, Josep; Sabburg, Jeff
- Journal of Atmospheric and Oceanic Technology, Vol. 25, Issue 1
Detecting clear sky images
journal, May 2019
- Pawar, Prathamesh; Cortés, Cristian; Murray, Keenan
- Solar Energy, Vol. 183
A method for cloud detection and opacity classification based on ground based sky imagery
journal, January 2012
- Ghonima, M. S.; Urquhart, B.; Chow, C. W.
- Atmospheric Measurement Techniques, Vol. 5, Issue 11
Determination of cloud transmittance for all sky imager based solar nowcasting
journal, March 2019
- Nouri, B.; Wilbert, S.; Segura, L.
- Solar Energy, Vol. 181
Nowcasting of DNI maps for the solar field based on voxel carving and individual 3D cloud objects from all sky images
conference, January 2018
- Nouri, Bijan; Kuhn, Pascal; Wilbert, Stefan
- SolarPACES 2017: International Conference on Concentrating Solar Power and Chemical Energy Systems, AIP Conference Proceedings
Correlation and local feature based cloud motion estimation
conference, January 2012
- Huang, Hao; Yoo, Shinjae; Yu, Dantong
- Proceedings of the Twelfth International Workshop on Multimedia Data Mining - MDMKDD '12
Automatic cloud classification of whole sky images
journal, January 2010
- Heinle, A.; Macke, A.; Srivastav, A.
- Atmospheric Measurement Techniques, Vol. 3, Issue 3
Solar forecasting methods for renewable energy integration
journal, December 2013
- Inman, Rich H.; Pedro, Hugo T. C.; Coimbra, Carlos F. M.
- Progress in Energy and Combustion Science, Vol. 39, Issue 6
Intra-hour forecasting with a total sky imager at the UC San Diego solar energy testbed
journal, November 2011
- Chow, Chi Wai; Urquhart, Bryan; Lave, Matthew
- Solar Energy, Vol. 85, Issue 11
pvlib python: a python package for modeling solar energy systems
journal, September 2018
- F. Holmgren, William; W. Hansen, Clifford; A. Mikofski, Mark
- Journal of Open Source Software, Vol. 3, Issue 29
Impact of local broadband turbidity estimation on forecasting of clear sky direct normal irradiance
journal, July 2015
- Inman, Rich H.; Edson, James G.; Coimbra, Carlos F. M.
- Solar Energy, Vol. 117
Worldwide performance assessment of 75 global clear-sky irradiance models using Principal Component Analysis
journal, September 2019
- Sun, Xixi; Bright, Jamie M.; Gueymard, Christian A.
- Renewable and Sustainable Energy Reviews, Vol. 111
Determination of the optimal camera distance for cloud height measurements with two all-sky imagers
journal, February 2019
- Kuhn, P.; Nouri, B.; Wilbert, S.
- Solar Energy, Vol. 179
Estimation of spectral distribution of sky radiance using a commercial digital camera
journal, January 2016
- Saito, Masanori; Iwabuchi, Hironobu; Murata, Isao
- Applied Optics, Vol. 55, Issue 2
A Short-Term Cloud Forecast Scheme Using Cross Correlations
journal, December 1993
- Hamill, Thomas M.; Nehrkorn, Thomas
- Weather and Forecasting, Vol. 8, Issue 4
Deep photovoltaic nowcasting
journal, December 2018
- Zhang, Jinsong; Verschae, Rodrigo; Nobuhara, Shohei
- Solar Energy, Vol. 176
Hybrid intra-hour DNI forecasts with sky image processing enhanced by stochastic learning
journal, December 2013
- Chu, Yinghao; Pedro, Hugo T. C.; Coimbra, Carlos F. M.
- Solar Energy, Vol. 98
Cloud tomography applied to sky images: A virtual testbed
journal, December 2018
- Mejia, Felipe A.; Kurtz, Ben; Levis, Aviad
- Solar Energy, Vol. 176
Real-time spectral radiance estimation of hemispherical clear skies with machine learned regression models
journal, July 2020
- Del Rocco, Joseph; Bourke, Paul D.; Patterson, Charles B.
- Solar Energy, Vol. 204
Data-Driven Probabilistic Net Load Forecasting With High Penetration of Behind-the-Meter PV
journal, May 2018
- Wang, Yi; Zhang, Ning; Chen, Qixin
- IEEE Transactions on Power Systems, Vol. 33, Issue 3
A Threshold Selection Method from Gray-Level Histograms
journal, January 1979
- Otsu, Nobuyuki
- IEEE Transactions on Systems, Man, and Cybernetics, Vol. 9, Issue 1
Assessment of forecasting techniques for solar power production with no exogenous inputs
journal, July 2012
- Pedro, Hugo T. C.; Coimbra, Carlos F. M.
- Solar Energy, Vol. 86, Issue 7
A Hybrid Thresholding Algorithm for Cloud Detection on Ground-Based Color Images
journal, October 2011
- Li, Qingyong; Lu, Weitao; Yang, Jun
- Journal of Atmospheric and Oceanic Technology, Vol. 28, Issue 10
The Use of Euclidean Geometric Distance on RGB Color Space for the Classification of Sky and Cloud Patterns
journal, September 2010
- Mantelli Neto, Sylvio Luiz; von Wangenheim, Aldo; Pereira, Enio Bueno
- Journal of Atmospheric and Oceanic Technology, Vol. 27, Issue 9
Real-Time Uncertainty Specification of All Sky Imager Derived Irradiance Nowcasts
journal, May 2019
- Nouri, Bijan; Wilbert, Stefan; Kuhn, Pascal
- Remote Sensing, Vol. 11, Issue 9