DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Power systems big data analytics: An assessment of paradigm shift barriers and prospects

Abstract

Electric power systems are taking drastic advances in deployment of information and communication technologies; numerous new measurement devices are installed in forms of advanced metering infrastructure, distributed energy resources (DER) monitoring systems, high frequency synchronized wide-area awareness systems that with great speed are generating immense volume of energy data. However, it is still questioned that whether the today’s power system data, the structures and the tools being developed are indeed aligned with the pillars of the big data science. Further, several requirements and especial features of power systems and energy big data call for customized methods and platforms. This paper provides an assessment of the distinguished aspects in big data analytics developments in the domain of power systems. We perform several taxonomy of the existing and the missing elements in the structures and methods associated with big data analytics in power systems. We also provide a holistic outline, classifications, and concise discussions on the technical approaches, research opportunities, and application areas for energy big data analytics.

Authors:
;
Publication Date:
Research Org.:
Univ. of California, Riverside, CA (United States)
Sponsoring Org.:
USDOE Office of Energy Efficiency and Renewable Energy (EERE), Renewable Power Office. Solar Energy Technologies Office
OSTI Identifier:
1633483
Alternate Identifier(s):
OSTI ID: 1613482
Grant/Contract Number:  
EE0008001; 1405330; 1462530
Resource Type:
Published Article
Journal Name:
Energy Reports
Additional Journal Information:
Journal Name: Energy Reports Journal Volume: 4 Journal Issue: C; Journal ID: ISSN 2352-4847
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION; energy; big data analytics; internet of energy; smart grid

Citation Formats

Akhavan-Hejazi, Hossein, and Mohsenian-Rad, Hamed. Power systems big data analytics: An assessment of paradigm shift barriers and prospects. United States: N. p., 2018. Web. doi:10.1016/j.egyr.2017.11.002.
Akhavan-Hejazi, Hossein, & Mohsenian-Rad, Hamed. Power systems big data analytics: An assessment of paradigm shift barriers and prospects. United States. https://doi.org/10.1016/j.egyr.2017.11.002
Akhavan-Hejazi, Hossein, and Mohsenian-Rad, Hamed. Thu . "Power systems big data analytics: An assessment of paradigm shift barriers and prospects". United States. https://doi.org/10.1016/j.egyr.2017.11.002.
@article{osti_1633483,
title = {Power systems big data analytics: An assessment of paradigm shift barriers and prospects},
author = {Akhavan-Hejazi, Hossein and Mohsenian-Rad, Hamed},
abstractNote = {Electric power systems are taking drastic advances in deployment of information and communication technologies; numerous new measurement devices are installed in forms of advanced metering infrastructure, distributed energy resources (DER) monitoring systems, high frequency synchronized wide-area awareness systems that with great speed are generating immense volume of energy data. However, it is still questioned that whether the today’s power system data, the structures and the tools being developed are indeed aligned with the pillars of the big data science. Further, several requirements and especial features of power systems and energy big data call for customized methods and platforms. This paper provides an assessment of the distinguished aspects in big data analytics developments in the domain of power systems. We perform several taxonomy of the existing and the missing elements in the structures and methods associated with big data analytics in power systems. We also provide a holistic outline, classifications, and concise discussions on the technical approaches, research opportunities, and application areas for energy big data analytics.},
doi = {10.1016/j.egyr.2017.11.002},
journal = {Energy Reports},
number = C,
volume = 4,
place = {United States},
year = {2018},
month = {11}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1016/j.egyr.2017.11.002

Citation Metrics:
Cited by: 15 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Chance-Constrained AC Optimal Power Flow for Distribution Systems With Renewables
journal, September 2017

  • DallAnese, Emiliano; Baker, Kyri; Summers, Tyler
  • IEEE Transactions on Power Systems, Vol. 32, Issue 5
  • DOI: 10.1109/TPWRS.2017.2656080

Power System State Estimation and Bad Data Detection by Means of Conic Relaxation
conference, January 2017

  • Madani, Ramtin; Lavaei, Javad; Baldick, Ross
  • Proceedings of the Annual Hawaii International Conference on System Sciences
  • DOI: 10.24251/HICSS.2017.375

Business Intelligence and Analytics: From Big Data to Big Impact
journal, January 2012


Unsupervised Disaggregation of Photovoltaic Production From Composite Power Flow Measurements of Heterogeneous Prosumers
journal, September 2018

  • Sossan, Fabrizio; Nespoli, Lorenzo; Medici, Vasco
  • IEEE Transactions on Industrial Informatics, Vol. 14, Issue 9
  • DOI: 10.1109/TII.2018.2791932

Forecasting of preprocessed daily solar radiation time series using neural networks
journal, December 2010


Wind turbine SCADA alarm analysis for improving reliability: Improving wind turbine reliability
journal, December 2011

  • Qiu, Yingning; Feng, Yanhui; Tavner, Peter
  • Wind Energy, Vol. 15, Issue 8
  • DOI: 10.1002/we.513

The internet of energy: a web-enabled smart grid system
journal, January 2012


Monitoring wind turbine gearboxes: Monitoring wind turbine gearboxes
journal, July 2012

  • Feng, Yanhui; Qiu, Yingning; Crabtree, Christopher J.
  • Wind Energy, Vol. 16, Issue 5
  • DOI: 10.1002/we.1521

Data-Driven Targeting of Customers for Demand Response
journal, September 2016


An unsupervised training method for non-intrusive appliance load monitoring
journal, December 2014


A data-driven analysis of lightning-initiated contingencies at a distribution grid with a PV farm using Micro-PMU data
conference, September 2017

  • Shahsavari, Alireza; Farajollahi, Mohammad; Stewart, Emma
  • 2017 North American Power Symposium (NAPS)
  • DOI: 10.1109/NAPS.2017.8107307

Zero Duality Gap in Optimal Power Flow Problem
journal, February 2012


MAD skills: new analysis practices for big data
journal, August 2009

  • Cohen, Jeffrey; Dolan, Brian; Dunlap, Mark
  • Proceedings of the VLDB Endowment, Vol. 2, Issue 2
  • DOI: 10.14778/1687553.1687576

The Smart Grid's Data Generating Potentials
conference, September 2014

  • Aiello, Marco; Pagani, Giuliano Andrea
  • 2014 Federated Conference on Computer Science and Information Systems, Annals of Computer Science and Information Systems
  • DOI: 10.15439/2014F509

ScaLAPACK: a portable linear algebra library for distributed memory computers — design issues and performance
journal, August 1996


Mobile social media for smart grids customer engagement: Emerging trends and challenges
journal, January 2016

  • Moreno-Munoz, A.; Bellido-Outeirino, F. J.; Siano, P.
  • Renewable and Sustainable Energy Reviews, Vol. 53
  • DOI: 10.1016/j.rser.2015.09.077

Exploiting massive PMU data analysis for LV distribution network model validation
conference, September 2015

  • Shand, Corinne; McMorran, Alan; Stewart, Emma
  • 2015 50th International Universities Power Engineering Conference (UPEC)
  • DOI: 10.1109/UPEC.2015.7339798

A formal definition of Big Data based on its essential features
journal, April 2016


Modeling and Optimization for Big Data Analytics: (Statistical) learning tools for our era of data deluge
journal, September 2014

  • Slavakis, Konstantinos; Giannakis, Georgios B.; Mateos, Gonzalo
  • IEEE Signal Processing Magazine, Vol. 31, Issue 5
  • DOI: 10.1109/MSP.2014.2327238

Household Energy Consumption Segmentation Using Hourly Data
journal, January 2014

  • Kwac, Jungsuk; Flora, June; Rajagopal, Ram
  • IEEE Transactions on Smart Grid, Vol. 5, Issue 1
  • DOI: 10.1109/TSG.2013.2278477

Intra-hour forecasting with a total sky imager at the UC San Diego solar energy testbed
journal, November 2011


Optimal Dispatch of Residential Photovoltaic Inverters Under Forecasting Uncertainties
journal, January 2015

  • Dall'Anese, Emiliano; Dhople, Sairaj V.; Johnson, Brian B.
  • IEEE Journal of Photovoltaics, Vol. 5, Issue 1
  • DOI: 10.1109/JPHOTOV.2014.2364125

Accelerating the Benders decomposition for network-constrained unit commitment problems
journal, June 2010


Event detection and localization in distribution grids with phasor measurement units
conference, July 2017

  • Ardakanian, Omid; Yuan, Ye; Dobbe, Roel
  • 2017 IEEE Power & Energy Society General Meeting (PESGM)
  • DOI: 10.1109/PESGM.2017.8273895

Fully Distributed State Estimation for Wide-Area Monitoring Systems
journal, September 2012


The Internet of Energy: Smart Sensor Networks and Big Data Management for Smart Grid
journal, January 2015


Applying thermophysics for wind turbine drivetrain fault diagnosis using SCADA data
journal, May 2016


An Approach of Quantifying Gear Fatigue Life for Wind Turbine Gearboxes Using Supervisory Control and Data Acquisition Data
journal, July 2017

  • Qiu, Yingning; Chen, Lang; Feng, Yanhui
  • Energies, Vol. 10, Issue 8
  • DOI: 10.3390/en10081084

Addressing the challenges for integrating micro-synchrophasor data with operational system applications
conference, July 2014

  • Stewart, E. M.; Kiliccote, S.; Shand, C. M.
  • 2014 IEEE Power & Energy Society General Meeting, 2014 IEEE PES General Meeting | Conference & Exposition
  • DOI: 10.1109/PESGM.2014.6938994

E-Sketch: Gathering large-scale energy consumption data based on consumption patterns
conference, October 2014


Energy Big Data Analytics and Security: Challenges and Opportunities
journal, September 2016


Social networking for Smart Grid users
conference, April 2015

  • Huang, Yilin; Warnier, Martijn; Brazier, Frances
  • 2015 IEEE 12th International Conference on Networking, Sensing and Control (ICNSC)
  • DOI: 10.1109/ICNSC.2015.7116077

The US National Lightning Detection Network/sup TM/ and applications of cloud-to-ground lightning data by electric power utilities
journal, January 1998

  • Cummins, K. L.; Krider, E. P.; Malone, M. D.
  • IEEE Transactions on Electromagnetic Compatibility, Vol. 40, Issue 4
  • DOI: 10.1109/15.736207

Stochastic Optimal Power Flow Based on Data-Driven Distributionally Robust Optimization
conference, June 2018


Fuzzy ART Neural Network Algorithm for Classifying the Power System Faults
journal, April 2005


A decomposition method for network-constrained unit commitment with AC power flow constraints
journal, August 2015


Data-Driven Wind Turbine Power Generation Performance Monitoring
journal, October 2015

  • Long, Huan; Wang, Long; Zhang, Zijun
  • IEEE Transactions on Industrial Electronics, Vol. 62, Issue 10
  • DOI: 10.1109/TIE.2015.2447508

Distribution Grid Reliability Versus Regulation Market Efficiency: An Analysis Based on Micro-PMU Data
journal, November 2017

  • Shahsavari, Alireza; Sadeghi-Mobarakeh, Ashkan; Stewart, Emma M.
  • IEEE Transactions on Smart Grid, Vol. 8, Issue 6
  • DOI: 10.1109/TSG.2017.2718560