skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Large-Scale Data Challenges in Future Power Grids

Abstract

This paper describes technical challenges in supporting large-scale real-time data analysis for future power grid systems and discusses various design options to address these challenges. Even though the existing U.S. power grid has served the nation remarkably well over the last 120 years, big changes are in the horizon. The widespread deployment of renewable generation, smart grid controls, energy storage, plug-in hybrids, and new conducting materials will require fundamental changes in the operational concepts and principal components. The whole system becomes highly dynamic and needs constant adjustments based on real time data. Even though millions of sensors such as phase measurement units (PMUs) and smart meters are being widely deployed, a data layer that can support this amount of data in real time is needed. Unlike the data fabric in cloud services, the data layer for smart grids must address some unique challenges. This layer must be scalable to support millions of sensors and a large number of diverse applications and still provide real time guarantees. Moreover, the system needs to be highly reliable and highly secure because the power grid is a critical piece of infrastructure. No existing systems can satisfy all the requirements at the same time. Wemore » examine various design options. In particular, we explore the special characteristics of power grid data to meet both scalability and quality of service requirements. Our initial prototype can improve performance by orders of magnitude over existing general-purpose systems. The prototype was demonstrated with several use cases from PNNL’s FPGI and was shown to be able to integrate huge amount of data from a large number of sensors and a diverse set of applications.« less

Authors:
; ; ;
Publication Date:
Research Org.:
Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1092012
Report Number(s):
PNNL-SA-93213
DOE Contract Number:  
AC05-76RL01830
Resource Type:
Conference
Resource Relation:
Conference: 7th International Symposium on Service Oriented System Engineering (SOSE'2013), March 25-28, 2013, Redwood City, CA, 324-328
Country of Publication:
United States
Language:
English
Subject:
Smart Grid, Real Time, Commercial Products, Big Data, QOS

Citation Formats

Yin, Jian, Sharma, Poorva, Gorton, Ian, and Akyol, Bora A. Large-Scale Data Challenges in Future Power Grids. United States: N. p., 2013. Web. doi:10.1109/SOSE.2013.71.
Yin, Jian, Sharma, Poorva, Gorton, Ian, & Akyol, Bora A. Large-Scale Data Challenges in Future Power Grids. United States. https://doi.org/10.1109/SOSE.2013.71
Yin, Jian, Sharma, Poorva, Gorton, Ian, and Akyol, Bora A. 2013. "Large-Scale Data Challenges in Future Power Grids". United States. https://doi.org/10.1109/SOSE.2013.71.
@article{osti_1092012,
title = {Large-Scale Data Challenges in Future Power Grids},
author = {Yin, Jian and Sharma, Poorva and Gorton, Ian and Akyol, Bora A.},
abstractNote = {This paper describes technical challenges in supporting large-scale real-time data analysis for future power grid systems and discusses various design options to address these challenges. Even though the existing U.S. power grid has served the nation remarkably well over the last 120 years, big changes are in the horizon. The widespread deployment of renewable generation, smart grid controls, energy storage, plug-in hybrids, and new conducting materials will require fundamental changes in the operational concepts and principal components. The whole system becomes highly dynamic and needs constant adjustments based on real time data. Even though millions of sensors such as phase measurement units (PMUs) and smart meters are being widely deployed, a data layer that can support this amount of data in real time is needed. Unlike the data fabric in cloud services, the data layer for smart grids must address some unique challenges. This layer must be scalable to support millions of sensors and a large number of diverse applications and still provide real time guarantees. Moreover, the system needs to be highly reliable and highly secure because the power grid is a critical piece of infrastructure. No existing systems can satisfy all the requirements at the same time. We examine various design options. In particular, we explore the special characteristics of power grid data to meet both scalability and quality of service requirements. Our initial prototype can improve performance by orders of magnitude over existing general-purpose systems. The prototype was demonstrated with several use cases from PNNL’s FPGI and was shown to be able to integrate huge amount of data from a large number of sensors and a diverse set of applications.},
doi = {10.1109/SOSE.2013.71},
url = {https://www.osti.gov/biblio/1092012}, journal = {},
number = ,
volume = ,
place = {United States},
year = {Mon Mar 25 00:00:00 EDT 2013},
month = {Mon Mar 25 00:00:00 EDT 2013}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: