DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Automated Extraction of Energy Systems Information from Remotely Sensed Data: A Review and Analysis

Journal Article · · Applied Energy
 [1];  [1];  [1];  [2];  [3];  [1];  [4]
  1. Duke University, Durham, NC (United States)
  2. National Renewable Energy Laboratory (NREL), Golden, CO (United States)
  3. World Resources Institute, Washington, D.C (United States)
  4. University of Montana, Missoula, MT (United States)

We report high quality energy systems information is a crucial input to energy systems research, modeling, and decision-making. Unfortunately, actionable information about energy systems is often of limited availability, incomplete, or only accessible for a substantial fee or through a non-disclosure agreement. Recently, remotely sensed data (e.g., satellite imagery, aerial photography) have emerged as a potentially rich source of energy systems information. However, the use of these data is frequently challenged by its sheer volume and complexity, precluding manual analysis. Recent breakthroughs in machine learning have enabled automated and rapid extraction of useful information from remotely sensed data, facilitating large-scale acquisition of critical energy system variables. Here we present a systematic review of the literature on this emerging topic, providing an in-depth survey and review of papers published within the past two decades. We first taxonomize the existing literature into ten major areas, spanning the energy value chain. Within each research area, we distill and critically discuss major features that are relevant to energy researchers, including, for example, key challenges regarding the accessibility and reliability of the methods. We then synthesize our findings to identify limitations and trends in the literature as a whole, and discuss opportunities for innovation. These include the opportunity to extend the methods beyond electricity to broader energy systems and wider geographic areas; and the ability to expand the use of these methods in research and decision making as satellite data become cheaper and easier to access. We also find that there are persistent challenges: limited standardization and rigor of performance assessments; limited sharing of code, which would improve replicability; and a limited consideration of the ethics and privacy of data.

Research Organization:
National Renewable Energy Laboratory (NREL), Golden, CO (United States)
Sponsoring Organization:
USDOE; national Science Foundation (NSF)
Grant/Contract Number:
AC36-08GO28308; OIA-1937137
OSTI ID:
1903025
Report Number(s):
NREL/JA-6A20-77734; MainId:30649; UUID:167efa42-0395-4333-9a98-95f3542e3e16; MainAdminID:68203
Journal Information:
Applied Energy, Vol. 326; ISSN 0306-2619
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (208)

DeepSolar: A Machine Learning Framework to Efficiently Construct a Solar Deployment Database in the United States journal December 2018
Coal Quality Exploration Technology Based on an Incremental Multilayer Extreme Learning Machine and Remote Sensing Images journal July 2019
Estimation of the Solar Energy Potential in Greece Using Satellite and Ground-Based Observations book September 2016
Large-scale solar panel mapping from aerial images using deep convolutional networks conference December 2016
Insulator Recognition and Fault Detection Using Deep Learning Approach journal February 2020
Deep learning journal May 2015
Wind Turbine Surface Damage Detection by Deep Learning Aided Drone Inspection Analysis journal February 2019
Assessing Accuracy and Geographical Transferability of Machine Learning Algorithms for Wind Speed Modelling book January 2017
Solar Power Prediction Based on Satellite Images and Support Vector Machine journal July 2016
A Review of Progress and Applications of Pulsed Doppler Wind LiDARs journal October 2019
A deep convolutional neural network and a random forest classifier for solar photovoltaic array detection in aerial imagery conference November 2016
Advances in vegetation management for power line corridor monitoring using aerial remote sensing techniques conference October 2010
Ethics and Privacy in AI and Big Data: Implementing Responsible Research and Innovation journal May 2018
Convolutional neural network based solar photovoltaic panel detection in satellite photos
  • Golovko, Vladimir; Bezobrazov, Sergei; Kroshchanka, Alexander
  • 2017 9th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS) https://doi.org/10.1109/IDAACS.2017.8094501
conference September 2017
A review of wind power forecasting & prediction conference October 2016
Aerial image analysis based on improved adaptive clustering for photovoltaic module inspection conference September 2017
Deep learning in the built environment: automatic detection of rooftop solar panels using Convolutional Neural Networks journal November 2019
UAV Transmission Line Inspection Object Recognition based on Mask R-CNN journal November 2019
Machine learning regressors for solar radiation estimation from satellite data journal May 2019
Estimation of shortwave solar radiation using the artificial neural network from Himawari-8 satellite imagery over China journal January 2020
LBP-HF features and machine learning applied for automated monitoring of insulators for overhead power distribution lines conference March 2016
Transmission Line Image Defect Diagnosis Preprocessed Parallel Method Based on Deep Learning conference September 2018
Remote sensing of night lights: A review and an outlook for the future journal February 2020
Predictive mapping of the global power system using open data journal January 2020
LIDAR and SODAR Measurements of Wind Speed and Direction in Upland Terrain for Wind Energy Purposes journal August 2011
Data Fusion and Remote Sensing: An ever-growing relationship journal December 2016
A neural network as a nonlinear transfer function model for retrieving surface wind speeds from the special sensor microwave imager journal January 1995
Urban solar utilization potential mapping via deep learning technology: A case study of Wuhan, China journal September 2019
scikit-image: image processing in Python journal January 2014
A new deep learning architecture for detection of long linear infrastructure conference May 2017
Spatial distribution of building energy use in the United States through satellite imagery of the earth at night journal September 2018
A new approach for oil tank detection using deep learning features with control false alarm rate in high-resolution satellite imagery journal November 2019
New methods to improve the vertical extrapolation of near-surface offshore wind speeds journal January 2021
Monitoring hydropower reliability in Malawi with satellite data and machine learning journal January 2020
Learning-Based Emulation of Sea Surface Wind Fields From Numerical Model Outputs and SAR Data journal October 2015
Recognition of insulator explosion based on deep learning conference December 2017
Estimating the electricity generation capacity of solar photovoltaic arrays using only color aerial imagery conference July 2017
Research on Recognition Method of Electrical Components Based on YOLO V3 journal January 2019
Towards automatic power line detection for a UAV surveillance system using pulse coupled neural filter and an improved Hough transform journal September 2009
Spatial Assessment of Solar Radiation by Machine Learning and Deep Neural Network Models Using Data Provided by the COMS MI Geostationary Satellite: A Case Study in South Korea journal May 2019
Satellite Observations Reveal Inequalities in the Progress and Effectiveness of Recent Electrification in Sub-Saharan Africa journal April 2020
Semantic Labeling of Aerial and Satellite Imagery journal July 2016
Typical Defect Detection Technology of Transmission Line Based on Deep Learning conference November 2019
Automatic Pixel-Level Crack Detection on Dam Surface Using Deep Convolutional Network journal April 2020
Forecasting long-term global solar radiation with an ANN algorithm coupled with satellite-derived (MODIS) land surface temperature (LST) for regional locations in Queensland journal May 2017
Detection for power transmission line in low-resolution aerial image conference December 2017
Estimation of rooftop solar energy generation using Satellite Image Segmentation conference December 2019
Enhancement of an Algorithm for Oil Tank Detection in Satellite Images journal June 2017
An Unmanned Inspection System for Multiple Defects Detection in Photovoltaic Plants journal March 2020
Detection of oil wells based on faster R-CNN in optical satellite remote sensing images conference September 2020
Comparison of modelling ANN and ELM to estimate solar radiation over Turkey using NOAA satellite data journal August 2013
Combined Convolutional and Structured Features for Power Line Detection in UAV Images conference July 2019
Near Real-Time Automated Detection of Small Hazardous Liquid Pipeline Leaks Using Remote Optical Sensing and Machine Learning conference September 2016
Pole and Crossarm Identification in Distribution Power Line Images conference October 2013
Estimation of the building energy use intensity in the urban scale by integrating GIS and big data technology journal December 2016
Outdoor Insulator Surface Condition Evaluation using Image Classification conference September 2018
Satellite data for the social sciences: measuring rural electrification with night-time lights journal January 2018
Point-based Classification of Power Line Corridor Scene Using Random Forests journal September 2013
Surface Coverage Classification of UAV High Resolution Image Transmission Lines Corridor based on Total Convolution Neural Network journal September 2018
Detection of rural electrification in Africa using DMSP-OLS night lights imagery journal September 2013
Automatic detection of solar photovoltaic arrays in high resolution aerial imagery journal December 2016
Machine Learning for Sustainable Energy Systems journal October 2021
Supervised Classification of Power Lines from Airborne LiDAR Data in Urban Areas journal July 2017
Artificial neural network based daily local forecasting for global solar radiation journal October 2014
Universally deployable extreme learning machines integrated with remotely sensed MODIS satellite predictors over Australia to forecast global solar radiation: A new approach journal April 2019
An Improved Photovoltaic Power Forecasting Model With the Assistance of Aerosol Index Data journal April 2015
Surface coal mine area monitoring using multi-temporal high-resolution satellite imagery journal April 2011
Detection for Power line Inspection journal January 2017
Synergistic Use of Nighttime Satellite Data, Electric Utility Infrastructure, and Ambient Population to Improve Power Outage Detections in Urban Areas journal March 2017
Deep Learning Neural Networks Trained with MODIS Satellite-Derived Predictors for Long-Term Global Solar Radiation Prediction journal June 2019
A Review of Domain Adaptation without Target Labels journal March 2021
OTL-Classifier: Towards Imaging Processing for Future Unmanned Overhead Transmission Line Maintenance journal November 2019
A deep learning algorithm to estimate hourly global solar radiation from geostationary satellite data journal October 2019
Identification of Icing Thickness of Transmission Line Based on Strongly Generalized Convolutional Neural Network conference May 2018
A detailed literature review on wind forecasting conference February 2013
Quantifying rooftop photovoltaic solar energy potential: A machine learning approach journal January 2017
Research on The Detection Method for Insulation Piercing Connectors and Bolts on The Transmission Line Based on SSD Algorithm conference December 2019
An assessment of global electric power consumption using the Defense Meteorological Satellite Program-Operational Linescan System nighttime light imagery journal December 2019
Distributed solar photovoltaic array location and extent dataset for remote sensing object identification journal December 2016
Data Driven Faster R-CNN for Transmission Line Object Detection book January 2019
Modeling of solar radiation using remote sensing and artificial neural network in Turkey journal December 2010
Oil spill detection by satellite remote sensing journal March 2005
A simple and efficient algorithm to estimate daily global solar radiation from geostationary satellite data journal May 2011
Automatic Detection and Classification of Oil Tanks in Optical Satellite Images Based on Convolutional Neural Network book January 2016
Power Line Segmentation in Aerial Images Using Convolutional Neural Networks book January 2019
Determination of measuring sites for solar irradiance, based on cluster analysis of satellite-derived cloud estimations journal November 2013
Wind turbine blade surface inspection based on deep learning and UAV-taken images journal September 2019
Deep Learning Based Fossil-Fuel Power Plant Monitoring in High Resolution Remote Sensing Images: A Comparative Study journal May 2019
Solar Power Plant Detection on Multi-Spectral Satellite Imagery using Weakly-Supervised CNN with Feedback Features and m-PCNN Fusion conference January 2017
Deep Learning-Based System for Automatic Recognition and Diagnosis of Electrical Insulator Strings journal January 2019
Machine learning methods for solar radiation forecasting: A review journal May 2017
Machine Learning Nowcasting of PV Energy Using Satellite Data journal January 2019
High voltage outdoor insulator surface condition evaluation using aerial insulator images journal September 2019
Global Data Assimilation and Forecast Experiments Using SSM/I Wind Speed Data Derived from a Neural Network Algorithm journal December 1997
Weakly supervised learning with convolutional neural networks for power line localization conference November 2017
Modeling the spatial relation between urban morphology, land surface temperature and urban energy demand journal September 2020
Collect it all: national security, Big Data and governance journal October 2014
Ocean surface wind retrievals from special sensor microwave imager data with neural networks journal January 1994
Image Segmentation Method of Insulator in Transmission Line Based on Weighted Variable Fuzzy C-Means journal January 2017
The Synthinel-1 dataset: a collection of high resolution synthetic overhead imagery for building segmentation conference March 2020
A high-resolution gridded dataset to assess electrification in sub-Saharan Africa journal July 2019
Machine Learning Approach for Photovoltaic Panels Cleanliness Detection conference December 2019
Satellite image analysis and a hybrid ESSS/ANN model to forecast solar irradiance in the tropics journal March 2014
Detection of Geothermal Potential Zones Using Remote Sensing Techniques journal October 2019
ImageNet classification with deep convolutional neural networks journal May 2017
Systematic Comparison of Power Line Classification Methods from ALS and MLS Point Cloud Data journal August 2018
Rotation invariant power line insulator detection using local directional pattern and support vector machine conference October 2016
Detection of Power Line Insulator Defects Using Aerial Images Analyzed With Convolutional Neural Networks journal April 2020
Use of satellite data to improve solar radiation forecasting with Bayesian Artificial Neural Networks journal December 2015
Fast image recognition of transmission tower based on big data journal May 2018
Optimal Productivity in Solar Power Plants Based on Machine Learning and Engineering Management
  • Herraiz, Álvaro Huerta; Marugán, Alberto Pliego; Márquez, Fausto Pedro García
  • Proceedings of the Twelfth International Conference on Management Science and Engineering Management https://doi.org/10.1007/978-3-319-93351-1_77
book June 2018
Study on Power Line Insulator Defect Detection via Improved Faster Region-Based Convolutional Neural Network conference October 2019
The Deep Learning Based Power Line Defect Detection System Built on Data Collected by the Cablewalker Drone conference October 2019
Development of Power Transmission Line Defects Diagnosis System for UAV Inspection based on Binocular Depth Imaging Technology conference April 2019
Automated Seasonal Detection of Coal Surface Mine Regions from Landsat 8 OLI Images conference July 2019
Automatic Detection of Wind Turbine Blade Surface Cracks Based on UAV-Taken Images journal September 2017
Multiscale assessment of progress of electrification in Indonesia based on brightness level derived from nighttime satellite imagery journal May 2017
Research Progress on Few-Shot Learning for Remote Sensing Image Interpretation journal January 2021
Deep Convolutional Neural Network for Automatic Detection of Damaged Photovoltaic Cells journal May 2018
Differentiating mine-reclaimed grasslands from spectrally similar land cover using terrain variables and object-based machine learning classification journal September 2015
Learning for Tower Detection of Power Line Inspection journal April 2017
Transmission line detection using deep convolutional neural network conference May 2019
The use of night-time lights satellite imagery as a measure of Australia's regional electricity consumption and population distribution journal August 2010
Measuring “Reasonably Reliable” access to electricity services journal August 2020
Spatially-Explicit Prediction of Capacity Density Advances Geographic Characterization of Wind Power Technical Potential journal June 2021
Investigating the performance of support vector machine and artificial neural networks in predicting solar radiation on a tilted surface: Saudi Arabia case study journal November 2015
The CMOD7 Geophysical Model Function for ASCAT and ERS Wind Retrievals journal May 2017
Power Line Recognition From Aerial Images With Deep Learning journal October 2019
A Hierarchical Oil Tank Detector With Deep Surrounding Features for High-Resolution Optical Satellite Imagery journal October 2015
Unmanned Aerial Vehicle (UAV) Vision-based Detection of Power Line Poles by CPU-based Deep Learning Method conference July 2019
Self-adaptive differential evolutionary extreme learning machines for long-term solar radiation prediction with remotely-sensed MODIS satellite and Reanalysis atmospheric products in solar-rich cities journal June 2018
Insulator identification from aerial images using Support Vector Machine with background suppression conference June 2016
Transfer Learning based Photovoltaic Module Defect Diagnosis using Aerial Images conference November 2018
Multi-angle Insulator Recognition Method in Infrared Image Based on Parallel Deep Convolutional Neural Networks book January 2017
Vegetation management of utility corridors using high-resolution hyperspectral imaging and LiDAR conference June 2010
Knowledge-based power line detection for UAV surveillance and inspection systems conference November 2008
Power infrastructure monitoring and damage detection using drone captured images conference May 2017
Estimating rural populations without access to electricity in developing countries through night-time light satellite imagery journal October 2010
The Energy-Poverty-Climate Nexus journal November 2010
Deep Learning Based Module Defect Analysis for Large-Scale Photovoltaic Farms journal March 2019
Unsupervised anomaly detection with compact deep features for wind turbine blade images taken by a drone journal June 2019
Automated Building Energy Consumption Estimation from Aerial Imagery conference July 2018
A city-scale roof shape classification using machine learning for solar energy applications journal June 2018
Deep Learning Based External-force-damage Detection for Power Transmission Line journal February 2019
The method of insulator recognition based on deep learning conference October 2016
Can we justify producing univariate machine-learning forecasts with satellite-derived solar irradiance? journal February 2020
DeepSolar for Germany: A deep learning framework for PV system mapping from aerial imagery conference September 2020
Study on the method of transmission line foreign body detection based on deep learning conference November 2017
Feature fusion based insulator detection for aerial inspection conference July 2017
Insulator Detection in Aerial Images Based on Faster Regions with Convolutional Neural Network conference June 2018
Estimation and Mapping of Solar Irradiance for Korea by Using COMS MI Satellite Images and an Artificial Neural Network Model journal January 2020
A novel line position recognition method in transmission line patrolling with UAV using machine learning algorithms
  • Wu, Yang; Luo, Yi; Zhao, Gen
  • 2018 IEEE International Symposium on Electromagnetic Compatibility and 2018 IEEE Asia-Pacific Symposium on Electromagnetic Compatibility (EMC/APEMC) https://doi.org/10.1109/ISEMC.2018.8393827
conference May 2018
Image Acquisition of Power Line Transmission Towers Using UAV and Deep Learning Technique for Insulators Localization and Recognition conference October 2019
Automatic detection of powerlines in UAV remote sensed images conference December 2015
Oil tank detection based on salient region and geometric features conference November 2014
Multi-patch deep features for power line insulator status classification from aerial images conference July 2016
An overview of the condition monitoring of overhead lines journal January 2000
Comparative analysis between VIIRS-DNB and DMSP-OLS night-time light data to estimate electric power consumption in Uttar Pradesh, India journal December 2019
An artificial neural network ensemble model for estimating global solar radiation from Meteosat satellite images journal November 2013
Statistical learning approach for wind resource assessment journal April 2016
Can semantic labeling methods generalize to any city? the inria aerial image labeling benchmark conference July 2017
Image classification towards transmission line fault detection via learning deep quality-aware fine-grained categorization journal October 2019
VIIRS night-time lights journal March 2017
Exploring Renewable Energy Resources Using Remote Sensing and GIS—A Review journal August 2019
Online 3-h forecasting of the power output from a BIPV system using satellite observations and ANN journal July 2018
Modeling of Electric Demand for Sustainable Energy and Management in India Using Spatio-Temporal DMSP-OLS Night-Time Data journal December 2017
Detecting Power Lines in UAV Images with Convolutional Features and Structured Constraints journal June 2019
A supervised approach to electric tower detection and classification for power line inspection conference July 2014
Just transition: Integrating climate, energy and environmental justice journal August 2018
Landsat and MODIS satellite image processing for solar irradiance estimation in the department of Narino-Colombia conference August 2016
Deep convolutional neural network processing of aerial stereo imagery to monitor vulnerable zones near power lines journal February 2018
Artificial intelligence faces reproducibility crisis journal February 2018
IN-YOLO: Real-Time Detection of Outdoor High Voltage Insulators Using UAV Imaging journal June 2020
Fault Detection in Power Equipment via an Unmanned Aerial System Using Multi Modal Data journal July 2019
A New Vision-Based Method Using Deep Learning for Damage Inspection in Wind Turbine Blades conference September 2018
A Method of Insulator Faults Detection in Aerial Images for High-Voltage Transmission Lines Inspection journal May 2019
Domain Adaptation for the Classification of Remote Sensing Data: An Overview of Recent Advances journal June 2016
Research on Image Recognition of Insulators Based on YOLO Algorithm conference November 2018
Image processing and machine learning applied for condition monitoring of 11-kV power distribution line insulators using curvelet and LTP features conference September 2017
Towards autonomous detection and tracking of electric towers for aerial power line inspection conference May 2014
Solar photovoltaic generation forecasting methods: A review journal January 2018
Power line detection via background noise removal conference December 2016
A machine learning approach for mapping the very shallow theoretical geothermal potential journal July 2019
Modeling electricity consumption using nighttime light images and artificial neural networks journal July 2019
Wind turbine tower detection using feature descriptors and deep learning journal January 2020
Intelligent Monitoring and Inspection of Power Line Components Powered by UAVs and Deep Learning journal March 2019
Wind source potential assessment using Sentinel 1 satellite and a new forecasting model based on machine learning: A case study Sardinia islands journal August 2020
Coal exploration technology based on visible-infrared spectra and remote sensing data journal September 2017
Using VIIRS Day/Night Band to Measure Electricity Supply Reliability: Preliminary Results from Maharashtra, India journal August 2016
Detecting urban-scale dynamics of electricity consumption at Chinese cities using time-series DMSP-OLS (Defense Meteorological Satellite Program-Operational Linescan System) nighttime light imageries journal April 2016
Combining solar irradiance measurements, satellite-derived data and a numerical weather prediction model to improve intra-day solar forecasting journal November 2016
Detecting Surface Defects of Wind Tubine Blades Using an Alexnet Deep Learning Algorithm journal December 2019
Coal Exploration Based on a Multilayer Extreme Learning Machine and Satellite Images journal January 2018
Mapping of the Solar Irradiance in the UAE Using Advanced Artificial Neural Network Ensemble journal August 2014
Distribution Line Pole Detection and Counting Based on YOLO Using UAV Inspection Line Video journal July 2019
Insulator Detection in Aerial Images for Transmission Line Inspection Using Single Shot Multibox Detector journal January 2019
Automatic solar photovoltaic panel detection in satellite imagery conference November 2015
Dam surface crack detection based on deep learning
  • Li, Linjing; Zhang, Hua; Pang, Jie
  • Proceedings of the 2019 International Conference on Robotics, Intelligent Control and Artificial Intelligence - RICAI 2019 https://doi.org/10.1145/3366194.3366327
conference January 2019
A deep convolutional neural network, with pre-training, for solar photovoltaic array detection in aerial imagery conference July 2017
Do Deep Learning Models Generalize to Overhead Imagery from Novel Geographic Domains? The xGD Benchmark Problem conference September 2020
Real-time Power Line Detection Network using Visible Light and Infrared Images conference December 2019
Tracking Electrification in Vietnam Using Nighttime Lights journal October 2014
Short-term forecasting of solar irradiance without local telemetry: A generalized model using satellite data journal October 2018
Coal mine area monitoring method by machine learning and multispectral remote sensing images journal December 2019
A Short-Term Wind Speed Forecasting Model by Using Artificial Neural Networks with Stochastic Optimization for Renewable Energy Systems journal October 2018
Application of extreme learning machine for estimating solar radiation from satellite data journal March 2013
Photovoltaic panel anomaly detection system based on Unmanned Aerial Vehicle platform journal March 2020
Estimating residential building energy consumption using overhead imagery journal December 2020