Search Menu
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information
Search Scholarly Publications

Title: UPS: Unified PMU-Data Storage System to Enhance T+D PMU Data Usability

Abstract

The emerging distribution-level phasor measurement unit (D-PMU) is expected to play an important role in enhancing distribution system observability and situational-awareness. It is a demanding yet challenging task to develop advanced D-PMU data management and analytics tools to improve D-PMU data usability and further promote D-PMU projects deployment. This paper focuses on D-PMU data processing and storage. It presents a brief review of existing D-PMU data storage systems and points out their limitations on high-performance, flexibility, and scalability. To overcome the limitations, a unified PMU-data storage system (UPS) is proposed. Specifically, a unified I/O interface between storage servers and computing jobs is developed to effectively reduce the overhead of managing various computing jobs and data analytics over multiple storage infrastructures; and PMUCache with PMUCache partitioning and PMUCache replacement algorithms are designed to support in-situ data processing and shared distributed data storage and further serve the computing jobs/queries with different Quality of Service (QoS) requirements. Through a series of experiments, it is demonstrated that UPS achieves high performance on fast and big data processing and storage, and efficiently increases the flexibility and scalability of PMU data management systems.

Authors:
 [1];  [2];  [1];  [1];  [2];  [3];  [3];  [3]
+ Show Author Affiliations
  1. Washington State Univ., Vancouver, WA (United States)
  2. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
  3. Univ. of Tennessee, Knoxville, TN (United States)
Publication Date:
Research Org.:
Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States); Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1524299
Alternate Identifier(s):
OSTI ID: 1712711
Report Number(s):
LLNL-JRN-L-760462
Journal ID: ISSN 1949-3053; 948347
Grant/Contract Number:  
AC52-07NA27344; AC05-00OR22725
Resource Type:
Accepted Manuscript
Journal Name:
IEEE Transactions on Smart Grid
Additional Journal Information:
Journal Volume: 11; Journal Issue: 1; Journal ID: ISSN 1949-3053
Publisher:
IEEE
Country of Publication:
United States
Language:
English
Subject:
42 ENGINEERING

Citation Formats

Kosen, Ian, Huang, Can, Chen, Zhi, Zhang, Xuechen, Liang, Min, Zhou, Dao, Zhu, Lin, and Liu, Yilu. UPS: Unified PMU-Data Storage System to Enhance T+D PMU Data Usability. United States: N. p., 2019. Web. doi:10.1109/TSG.2019.2916570.
Copy to clipboard
Kosen, Ian, Huang, Can, Chen, Zhi, Zhang, Xuechen, Liang, Min, Zhou, Dao, Zhu, Lin, & Liu, Yilu. UPS: Unified PMU-Data Storage System to Enhance T+D PMU Data Usability. United States. https://doi.org/10.1109/TSG.2019.2916570
Copy to clipboard
Kosen, Ian, Huang, Can, Chen, Zhi, Zhang, Xuechen, Liang, Min, Zhou, Dao, Zhu, Lin, and Liu, Yilu. Tue . "UPS: Unified PMU-Data Storage System to Enhance T+D PMU Data Usability". United States. https://doi.org/10.1109/TSG.2019.2916570. https://www.osti.gov/servlets/purl/1524299.
Copy to clipboard
@article{osti_1524299,
title = {UPS: Unified PMU-Data Storage System to Enhance T+D PMU Data Usability},
author = {Kosen, Ian and Huang, Can and Chen, Zhi and Zhang, Xuechen and Liang, Min and Zhou, Dao and Zhu, Lin and Liu, Yilu},
abstractNote = {The emerging distribution-level phasor measurement unit (D-PMU) is expected to play an important role in enhancing distribution system observability and situational-awareness. It is a demanding yet challenging task to develop advanced D-PMU data management and analytics tools to improve D-PMU data usability and further promote D-PMU projects deployment. This paper focuses on D-PMU data processing and storage. It presents a brief review of existing D-PMU data storage systems and points out their limitations on high-performance, flexibility, and scalability. To overcome the limitations, a unified PMU-data storage system (UPS) is proposed. Specifically, a unified I/O interface between storage servers and computing jobs is developed to effectively reduce the overhead of managing various computing jobs and data analytics over multiple storage infrastructures; and PMUCache with PMUCache partitioning and PMUCache replacement algorithms are designed to support in-situ data processing and shared distributed data storage and further serve the computing jobs/queries with different Quality of Service (QoS) requirements. Through a series of experiments, it is demonstrated that UPS achieves high performance on fast and big data processing and storage, and efficiently increases the flexibility and scalability of PMU data management systems.},
doi = {10.1109/TSG.2019.2916570},
journal = {IEEE Transactions on Smart Grid},
number = 1,
volume = 11,
place = {United States},
year = {Tue May 14 00:00:00 EDT 2019},
month = {Tue May 14 00:00:00 EDT 2019}
}
Copy to clipboard
Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1109/TSG.2019.2916570
Copyright Statement
Other availability
Search WorldCat Search WorldCat to find libraries that may hold this journal
Citation Metrics:
Cited by: 7 works
Citation information provided by
Web of Science
Save / Share:
Export Metadata
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.

Works referenced in this record:

Network Symmetry and Binocular Rivalry Experiments
journal, January 2014

  • Diekman, Casey O.; Golubitsky, Martin
  • The Journal of Mathematical Neuroscience, Vol. 4, Issue 1
  • DOI: 10.1186/2190-8567-4-12

Data quality issues for synchrophasor applications Part II: problem formulation and potential solutions
journal, July 2016

  • Huang, Can; Li, Fangxing; Zhan, Lingwei
  • Journal of Modern Power Systems and Clean Energy, Vol. 4, Issue 3
  • DOI: 10.1007/s40565-016-0213-8

Precision Micro-Synchrophasors for Distribution Systems: A Summary of Applications
journal, November 2017

  • von Meier, Alexandra; Stewart, Emma; McEachern, Alex
  • IEEE Transactions on Smart Grid, Vol. 8, Issue 6
  • DOI: 10.1109/tsg.2017.2720543

Monitoring power system disturbances based on distribution-level phasor measurements
conference, January 2012

Definition of System Angle Reference for Distribution Level Synchronized Angle Measurement Applications
journal, January 2019

A survey on next-generation power grid data architecture
conference, July 2015

A Survey of Techniques for Cache Partitioning in Multicore Processors
journal, May 2017

  • Mittal, Sparsh
  • ACM Computing Surveys, Vol. 50, Issue 2
  • DOI: 10.1145/3062394

Dynamic partitioning of the cache hierarchy in shared data centers
journal, August 2008

  • Soundararajan, Gokul; Chen, Jin; Sharaf, Mohamed A.
  • Proceedings of the VLDB Endowment, Vol. 1, Issue 1
  • DOI: 10.14778/1453856.1453926

Synchrophasor data analytics in distribution grids
conference, April 2017

  • Arnold, Daniel B.; Roberts, Ciaran; Ardakanian, Omid
  • 2017 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT)
  • DOI: 10.1109/ISGT.2017.8085979

MapReduce: simplified data processing on large clusters
journal, January 2008

  • Dean, Jeffrey; Ghemawat, Sanjay; Mehta, Brijesh
  • Communications of the ACM, Vol. 51, Issue 1
  • DOI: 10.1145/1327452.1327492

Enhancing Observability in Distribution Grids Using Smart Meter Data
journal, November 2018

  • Bhela, Siddharth; Kekatos, Vassilis; Veeramachaneni, Sriharsha
  • IEEE Transactions on Smart Grid, Vol. 9, Issue 6
  • DOI: 10.1109/TSG.2017.2699939

An Overview of the IEEE Standard C37.118.2—Synchrophasor Data Transfer for Power Systems
journal, July 2014

  • Martin, K. E.; Brunello, G.; Adamiak, M. G.
  • IEEE Transactions on Smart Grid, Vol. 5, Issue 4
  • DOI: 10.1109/TSG.2014.2302016

$S^{3}A$: A Secure Data Sharing Mechanism for Situational Awareness in The Power Grid
journal, December 2013

  • Tong, Yue; Deyton, Jordan; Sun, Jinyuan
  • IEEE Transactions on Smart Grid, Vol. 4, Issue 4
  • DOI: 10.1109/TSG.2013.2251016

Making sense of performance in in-memory computing frameworks for scientific data analysis: A case study of the spark system
journal, October 2018

  • Zhang, Xuechen; Khanal, Ujjwal; Zhao, Xinghui
  • Journal of Parallel and Distributed Computing, Vol. 120
  • DOI: 10.1016/j.jpdc.2017.10.016

DISTIL: Design and implementation of a scalable synchrophasor data processing system
conference, November 2015

  • Andersen, Michael P.; Kumar, Sam; Brooks, Connor
  • 2015 IEEE International Conference on Smart Grid Communications (SmartGridComm)
  • DOI: 10.1109/SmartGridComm.2015.7436312

Distributed Data Analytics Platform for Wide-Area Synchrophasor Measurement Systems
journal, September 2016

Coordination between transmission and distribution system operators in the electricity sector: A conceptual framework
journal, February 2018

Data quality issues for synchrophasor applications Part I: a review
journal, July 2016

  • Huang, Can; Li, Fangxing; Zhou, Dao
  • Journal of Modern Power Systems and Clean Energy, Vol. 4, Issue 3
  • DOI: 10.1007/s40565-016-0217-4

Applications of synchrophasor technologies in power systems
journal, October 2018

  • Usman, Muhammad Usama; Faruque, M. Omar
  • Journal of Modern Power Systems and Clean Energy, Vol. 7, Issue 2
  • DOI: 10.1007/s40565-018-0455-8

A Hierarchical Modeling for Reactive Power Optimization With Joint Transmission and Distribution Networks by Curve Fitting
journal, September 2018

Data quality issues for synchrophasor applications Part II: problem formulation and potential solutions
journal, July 2016

  • Huang, Can; Li, Fangxing; Zhan, Lingwei
  • Journal of Modern Power Systems and Clean Energy, Vol. 4, Issue 3
  • DOI: 10.1007/s40565-016-0213-8

Distribution Synchrophasors: Pairing Big Data with Analytics to Create Actionable Information
journal, May 2018

  • Mohsenian-Rad, Hamed; Stewart, Emma; Cortez, Ed
  • IEEE Power and Energy Magazine, Vol. 16, Issue 3
  • DOI: 10.1109/MPE.2018.2790818

Phasor measurement units, WAMS, and their applications in protection and control of power systems
journal, July 2018

  • Phadke, Arun G.; Bi, Tianshu
  • Journal of Modern Power Systems and Clean Energy, Vol. 6, Issue 4
  • DOI: 10.1007/s40565-018-0423-3

A high-performance, low-cost PMU prototype for distribution networks based on FPGA
conference, June 2017

Synchronized Phasor Measurement Applications in Power Systems
journal, June 2010

  • De La Ree, Jaime; Centeno, Virgilio; Thorp, James S.
  • IEEE Transactions on Smart Grid, Vol. 1, Issue 1
  • DOI: 10.1109/TSG.2010.2044815

A Distribution Level Wide Area Monitoring System for the Electric Power Grid–FNET/GridEye
journal, January 2017

Mining PMU Data Streams to Improve Electric Power System Resilience
conference, December 2017

  • Jiang, Jun; Zhao, Xinghui; Wallace, Scott
  • Proceedings of the Fourth IEEE/ACM International Conference on Big Data Computing, Applications and Technologies
  • DOI: 10.1145/3148055.3148082
    Sort by:
    [ × clear filter / sort ]

    Similar Records in DOE PAGES and OSTI.GOV collections: