Power systems big data analytics: An assessment of paradigm shift barriers and prospects
Abstract
Electric power systems are taking drastic advances in deployment of information and communication technologies; numerous new measurement devices are installed in forms of advanced metering infrastructure, distributed energy resources (DER) monitoring systems, high frequency synchronized wide-area awareness systems that with great speed are generating immense volume of energy data. However, it is still questioned that whether the today’s power system data, the structures and the tools being developed are indeed aligned with the pillars of the big data science. Further, several requirements and especial features of power systems and energy big data call for customized methods and platforms. This paper provides an assessment of the distinguished aspects in big data analytics developments in the domain of power systems. We perform several taxonomy of the existing and the missing elements in the structures and methods associated with big data analytics in power systems. We also provide a holistic outline, classifications, and concise discussions on the technical approaches, research opportunities, and application areas for energy big data analytics.
- Authors:
- Publication Date:
- Research Org.:
- Univ. of California, Riverside, CA (United States)
- Sponsoring Org.:
- USDOE Office of Energy Efficiency and Renewable Energy (EERE), Renewable Power Office. Solar Energy Technologies Office
- OSTI Identifier:
- 1633483
- Alternate Identifier(s):
- OSTI ID: 1613482
- Grant/Contract Number:
- EE0008001; 1405330; 1462530
- Resource Type:
- Published Article
- Journal Name:
- Energy Reports
- Additional Journal Information:
- Journal Name: Energy Reports Journal Volume: 4 Journal Issue: C; Journal ID: ISSN 2352-4847
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION; energy; big data analytics; internet of energy; smart grid
Citation Formats
Akhavan-Hejazi, Hossein, and Mohsenian-Rad, Hamed. Power systems big data analytics: An assessment of paradigm shift barriers and prospects. United States: N. p., 2018.
Web. doi:10.1016/j.egyr.2017.11.002.
Akhavan-Hejazi, Hossein, & Mohsenian-Rad, Hamed. Power systems big data analytics: An assessment of paradigm shift barriers and prospects. United States. https://doi.org/10.1016/j.egyr.2017.11.002
Akhavan-Hejazi, Hossein, and Mohsenian-Rad, Hamed. Thu .
"Power systems big data analytics: An assessment of paradigm shift barriers and prospects". United States. https://doi.org/10.1016/j.egyr.2017.11.002.
@article{osti_1633483,
title = {Power systems big data analytics: An assessment of paradigm shift barriers and prospects},
author = {Akhavan-Hejazi, Hossein and Mohsenian-Rad, Hamed},
abstractNote = {Electric power systems are taking drastic advances in deployment of information and communication technologies; numerous new measurement devices are installed in forms of advanced metering infrastructure, distributed energy resources (DER) monitoring systems, high frequency synchronized wide-area awareness systems that with great speed are generating immense volume of energy data. However, it is still questioned that whether the today’s power system data, the structures and the tools being developed are indeed aligned with the pillars of the big data science. Further, several requirements and especial features of power systems and energy big data call for customized methods and platforms. This paper provides an assessment of the distinguished aspects in big data analytics developments in the domain of power systems. We perform several taxonomy of the existing and the missing elements in the structures and methods associated with big data analytics in power systems. We also provide a holistic outline, classifications, and concise discussions on the technical approaches, research opportunities, and application areas for energy big data analytics.},
doi = {10.1016/j.egyr.2017.11.002},
journal = {Energy Reports},
number = C,
volume = 4,
place = {United States},
year = {2018},
month = {11}
}
https://doi.org/10.1016/j.egyr.2017.11.002
Web of Science
Works referenced in this record:
Chance-Constrained AC Optimal Power Flow for Distribution Systems With Renewables
journal, September 2017
- DallAnese, Emiliano; Baker, Kyri; Summers, Tyler
- IEEE Transactions on Power Systems, Vol. 32, Issue 5
Power System State Estimation and Bad Data Detection by Means of Conic Relaxation
conference, January 2017
- Madani, Ramtin; Lavaei, Javad; Baldick, Ross
- Proceedings of the Annual Hawaii International Conference on System Sciences
Business Intelligence and Analytics: From Big Data to Big Impact
journal, January 2012
- Chen,
- MIS Quarterly, Vol. 36, Issue 4
Unsupervised Disaggregation of Photovoltaic Production From Composite Power Flow Measurements of Heterogeneous Prosumers
journal, September 2018
- Sossan, Fabrizio; Nespoli, Lorenzo; Medici, Vasco
- IEEE Transactions on Industrial Informatics, Vol. 14, Issue 9
Forecasting of preprocessed daily solar radiation time series using neural networks
journal, December 2010
- Paoli, Christophe; Voyant, Cyril; Muselli, Marc
- Solar Energy, Vol. 84, Issue 12
Wind turbine SCADA alarm analysis for improving reliability: Improving wind turbine reliability
journal, December 2011
- Qiu, Yingning; Feng, Yanhui; Tavner, Peter
- Wind Energy, Vol. 15, Issue 8
The internet of energy: a web-enabled smart grid system
journal, January 2012
- Bui, Nicola; Castellani, Angelo; Casari, Paolo
- IEEE Network, Vol. 26, Issue 4
Monitoring wind turbine gearboxes: Monitoring wind turbine gearboxes
journal, July 2012
- Feng, Yanhui; Qiu, Yingning; Crabtree, Christopher J.
- Wind Energy, Vol. 16, Issue 5
Data-Driven Targeting of Customers for Demand Response
journal, September 2016
- Kwac, Jungsuk; Rajagopal, Ram
- IEEE Transactions on Smart Grid, Vol. 7, Issue 5
An unsupervised training method for non-intrusive appliance load monitoring
journal, December 2014
- Parson, Oliver; Ghosh, Siddhartha; Weal, Mark
- Artificial Intelligence, Vol. 217
A data-driven analysis of lightning-initiated contingencies at a distribution grid with a PV farm using Micro-PMU data
conference, September 2017
- Shahsavari, Alireza; Farajollahi, Mohammad; Stewart, Emma
- 2017 North American Power Symposium (NAPS)
Zero Duality Gap in Optimal Power Flow Problem
journal, February 2012
- Lavaei, Javad; Low, Steven H.
- IEEE Transactions on Power Systems, Vol. 27, Issue 1
MAD skills: new analysis practices for big data
journal, August 2009
- Cohen, Jeffrey; Dolan, Brian; Dunlap, Mark
- Proceedings of the VLDB Endowment, Vol. 2, Issue 2
The Smart Grid's Data Generating Potentials
conference, September 2014
- Aiello, Marco; Pagani, Giuliano Andrea
- 2014 Federated Conference on Computer Science and Information Systems, Annals of Computer Science and Information Systems
ScaLAPACK: a portable linear algebra library for distributed memory computers — design issues and performance
journal, August 1996
- Choi, J.; Demmel, J.; Dhillon, I.
- Computer Physics Communications, Vol. 97, Issue 1-2
Mobile social media for smart grids customer engagement: Emerging trends and challenges
journal, January 2016
- Moreno-Munoz, A.; Bellido-Outeirino, F. J.; Siano, P.
- Renewable and Sustainable Energy Reviews, Vol. 53
Exploiting massive PMU data analysis for LV distribution network model validation
conference, September 2015
- Shand, Corinne; McMorran, Alan; Stewart, Emma
- 2015 50th International Universities Power Engineering Conference (UPEC)
A formal definition of Big Data based on its essential features
journal, April 2016
- De Mauro, Andrea; Greco, Marco; Grimaldi, Michele
- Library Review, Vol. 65, Issue 3
Modeling and Optimization for Big Data Analytics: (Statistical) learning tools for our era of data deluge
journal, September 2014
- Slavakis, Konstantinos; Giannakis, Georgios B.; Mateos, Gonzalo
- IEEE Signal Processing Magazine, Vol. 31, Issue 5
Household Energy Consumption Segmentation Using Hourly Data
journal, January 2014
- Kwac, Jungsuk; Flora, June; Rajagopal, Ram
- IEEE Transactions on Smart Grid, Vol. 5, Issue 1
Intra-hour forecasting with a total sky imager at the UC San Diego solar energy testbed
journal, November 2011
- Chow, Chi Wai; Urquhart, Bryan; Lave, Matthew
- Solar Energy, Vol. 85, Issue 11
Optimal Dispatch of Residential Photovoltaic Inverters Under Forecasting Uncertainties
journal, January 2015
- Dall'Anese, Emiliano; Dhople, Sairaj V.; Johnson, Brian B.
- IEEE Journal of Photovoltaics, Vol. 5, Issue 1
Accelerating the Benders decomposition for network-constrained unit commitment problems
journal, June 2010
- Wu, Lei; Shahidehpour, Mohammad
- Energy Systems, Vol. 1, Issue 3
Event detection and localization in distribution grids with phasor measurement units
conference, July 2017
- Ardakanian, Omid; Yuan, Ye; Dobbe, Roel
- 2017 IEEE Power & Energy Society General Meeting (PESGM)
Fully Distributed State Estimation for Wide-Area Monitoring Systems
journal, September 2012
- Xie, Le; Choi, Dae-Hyun; Kar, Soummya
- IEEE Transactions on Smart Grid, Vol. 3, Issue 3
The Internet of Energy: Smart Sensor Networks and Big Data Management for Smart Grid
journal, January 2015
- Jaradat, Manar; Jarrah, Moath; Bousselham, Abdelkader
- Procedia Computer Science, Vol. 56
Applying thermophysics for wind turbine drivetrain fault diagnosis using SCADA data
journal, May 2016
- Qiu, Yingning; Feng, Yanhui; Sun, Juan
- IET Renewable Power Generation, Vol. 10, Issue 5
An Approach of Quantifying Gear Fatigue Life for Wind Turbine Gearboxes Using Supervisory Control and Data Acquisition Data
journal, July 2017
- Qiu, Yingning; Chen, Lang; Feng, Yanhui
- Energies, Vol. 10, Issue 8
Addressing the challenges for integrating micro-synchrophasor data with operational system applications
conference, July 2014
- Stewart, E. M.; Kiliccote, S.; Shand, C. M.
- 2014 IEEE Power & Energy Society General Meeting, 2014 IEEE PES General Meeting | Conference & Exposition
E-Sketch: Gathering large-scale energy consumption data based on consumption patterns
conference, October 2014
- Huang, Zhichuan; Luo, Hongyao; Skoda, David
- 2014 IEEE International Conference on Big Data (Big Data)
Energy Big Data Analytics and Security: Challenges and Opportunities
journal, September 2016
- Hu, Jiankun; Vasilakos, Athanasios V.
- IEEE Transactions on Smart Grid, Vol. 7, Issue 5
Social networking for Smart Grid users
conference, April 2015
- Huang, Yilin; Warnier, Martijn; Brazier, Frances
- 2015 IEEE 12th International Conference on Networking, Sensing and Control (ICNSC)
The US National Lightning Detection Network/sup TM/ and applications of cloud-to-ground lightning data by electric power utilities
journal, January 1998
- Cummins, K. L.; Krider, E. P.; Malone, M. D.
- IEEE Transactions on Electromagnetic Compatibility, Vol. 40, Issue 4
Stochastic Optimal Power Flow Based on Data-Driven Distributionally Robust Optimization
conference, June 2018
- Guo, Yi; Baker, Kyri; Dall'Anese, Emiliano
- 2018 Annual American Control Conference (ACC)
Fuzzy ART Neural Network Algorithm for Classifying the Power System Faults
journal, April 2005
- Vasilic, S.; Kezunovic, M.
- IEEE Transactions on Power Delivery, Vol. 20, Issue 2
A decomposition method for network-constrained unit commitment with AC power flow constraints
journal, August 2015
- Bai, Yang; Zhong, Haiwang; Xia, Qing
- Energy, Vol. 88
Data-Driven Wind Turbine Power Generation Performance Monitoring
journal, October 2015
- Long, Huan; Wang, Long; Zhang, Zijun
- IEEE Transactions on Industrial Electronics, Vol. 62, Issue 10
Distribution Grid Reliability Versus Regulation Market Efficiency: An Analysis Based on Micro-PMU Data
journal, November 2017
- Shahsavari, Alireza; Sadeghi-Mobarakeh, Ashkan; Stewart, Emma M.
- IEEE Transactions on Smart Grid, Vol. 8, Issue 6