skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A Data Quality Filter for PMU Measurements: Description, Experience, and Examples

Abstract

Networks of phasor measurement units (PMUs) continue to grow, and along with them, the amount of data available for analysis. With so much data, it is impractical to identify and remove poor quality data manually. The data quality filter described in this paper was developed for use with the Data Integrity and Situation Awareness Tool (DISAT), which analyzes PMU data to identify anomalous system behavior. The filter operates based only on the information included in the data files, without supervisory control and data acquisition (SCADA) data, state estimator values, or system topology information. Measurements are compared to preselected thresholds to determine if they are reliable. Along with the filter's description, examples of data quality issues from application of the filter to nine months of archived PMU data are provided. The paper is intended to aid the reader in recognizing and properly addressing data quality issues in PMU data.

Authors:
;
Publication Date:
Research Org.:
Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1339038
Report Number(s):
PNNL-SA-114314
TE1101000
DOE Contract Number:
AC05-76RL01830
Resource Type:
Conference
Resource Relation:
Conference: IEEE Power and Energy Society General Meeting (PESGM 2016), July 17-21, 2016, Boston, MA
Country of Publication:
United States
Language:
English
Subject:
Phasor Measurement Unit

Citation Formats

Follum, James D., and Amidan, Brett G. A Data Quality Filter for PMU Measurements: Description, Experience, and Examples. United States: N. p., 2016. Web. doi:10.1109/PESGM.2016.7741378.
Follum, James D., & Amidan, Brett G. A Data Quality Filter for PMU Measurements: Description, Experience, and Examples. United States. doi:10.1109/PESGM.2016.7741378.
Follum, James D., and Amidan, Brett G. 2016. "A Data Quality Filter for PMU Measurements: Description, Experience, and Examples". United States. doi:10.1109/PESGM.2016.7741378.
@article{osti_1339038,
title = {A Data Quality Filter for PMU Measurements: Description, Experience, and Examples},
author = {Follum, James D. and Amidan, Brett G.},
abstractNote = {Networks of phasor measurement units (PMUs) continue to grow, and along with them, the amount of data available for analysis. With so much data, it is impractical to identify and remove poor quality data manually. The data quality filter described in this paper was developed for use with the Data Integrity and Situation Awareness Tool (DISAT), which analyzes PMU data to identify anomalous system behavior. The filter operates based only on the information included in the data files, without supervisory control and data acquisition (SCADA) data, state estimator values, or system topology information. Measurements are compared to preselected thresholds to determine if they are reliable. Along with the filter's description, examples of data quality issues from application of the filter to nine months of archived PMU data are provided. The paper is intended to aid the reader in recognizing and properly addressing data quality issues in PMU data.},
doi = {10.1109/PESGM.2016.7741378},
journal = {},
number = ,
volume = ,
place = {United States},
year = 2016,
month = 7
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share:
  • In 2008, the Savannah River Site (SRS) began treatment of liquid radioactive waste from its Tank Farms. To treat waste streams containing {sup 137}Cs, {sup 90}Sr, and actinides, SRS developed the Actinide Removal Process (ARP) and the Modular Caustic Side Solvent Extraction Unit (MCU). The Actinide Removal Process contacts the waste with monosodium titanate (MST) to sorb strontium and select actinides. After MST contact, the process filters the resulting slurry to remove the MST (with sorbed strontium and actinides) and any entrained sludge. The filtrate is transported to the MCU to remove cesium. The solid particle removed by the filtermore » are concentrated to {approx} 5 wt %, washed to reduce the concentration of dissolved sodium, and transported to the Defense Waste Processing Facility (DWPF) for vitrification. The authors conducted tests with 0.5 {micro} and 0.1 {micro} Mott sintered stainless steel crossflow filter at bench-scale (0.19 ft{sup 2} surface area) and pilot-scale (11.2 ft{sup 2}). The collected data supported design of the filter for the process and identified preferred operating conditions for the full-scale process (230 ft{sup 2}). The testing investigated the influence of operating parameters, such as filter pore size, axial velocity, transmembrane pressure, and solids loading, on filter flux, and validated the simulant used for pilot-scale testing. The conclusions from this work follow: (1) The 0.1 {micro} Mott sintered stainless steel filter produced higher flux than the 0.5 {micro} filter. (2) The filtrate samples collected showed no visible solids. (3) The filter flux with actual waste is comparable to the filter flux with simulated waste, with the simulated waste being conservative. This result shows the simulated sludge is representative of the actual sludge. (4) When the data is adjusted for differences in transmembrane pressure, the filter flux in the Actinide Removal Process is comparable to the filter flux in the bench-scale and pilot-scale testing. (5) Filter flux increased with transmembrane pressure, increased with axial velocity, and decreased with concentration in agreement with classical crossflow filtration theories.« less
  • The absolute total cross sections for np and pp scattering below 1000 MeV are determined based on partial-wave analyses (PWAs) of nucleon-nucleon scattering data. These cross sections are compared with the most recent ENDF/B-VII.0 and JENDL-3.3 data files, and the Nijmegen PWA. Systematic deviations from the ENDF/B-VII.0 and JENDL-3.3 evaluations are found to exist in the low-energy region. Comparison of the np evaluation with the result of most recent np total and differential cross section measurements will be discussed. Results of those measurements were not used in the evaluation database. A comparison was done to check a quality of evaluationmore » and its capabilities to predict experimental observables. Excellent agreement was found between the new experimental data and our PWA predictions.« less
  • Reactivity perturbation experiments using various materials are being performed on the HEU fast core CALIBAN, an experimental device operated by the CEA VALDUC Criticality and Neutron Transport Research Laboratory. These experiments provide valuable information to contribute to the validation of nuclear data for the materials used in such measurements. This paper presents the results obtained in a first series of measurements performed with Au-197 samples. Experiments which have been conducted in order to improve the characterization of the core are also described and discussed. The experimental results have been compared to numerical calculation using both deterministic and Monte Carlo neutronmore » transport codes with a simplified model of the reactor. This early work led to a methodology which will be applied to the future experiments which will concern other materials of interest. (authors)« less
  • X-radiographs of cores from Forbes deep basin sands, the tar-saturated paralic sands of the Temblor and the Tulare fluvial sands and silts, as well as fractured siliceous units (the Monterey Formation and equivalents) reveal geologic features that are either not visible or barely discernible to the naked eye. These features include changes in grain size, grading, ripple lamination to cross-bedding, cyclic couplets in tidal sequences, bioturbation and burrowing, and fracture patterns and filling. Forbes core x-radiography from the northern Sacramento basin clearly shows a sequence of thinly bedded sand and mudstones that are microripple cross-laminated. Partial Bouma sequences (Ta-b ormore » Tb with Ta-c) are characteristic of the thickly bedded sands below the ripple-laminated units. Cyclic sequences of mud-turbidites and finely laminated, very fine-grained sands to coarse silts characterize a sand-poor sequence that overlies a massive to indistinctly thin-bedded sand. Most of these features described above are barely discernible without x-radiography, yet all provide major input to the interpretation of the depositional environment of the Forbes Formation, as well as information regarding reservoir continuity. Tar or heavy-oil saturation of cores can be a severe problem when cores are examined. In a Tulare Formation core sequence that was x-radiographed, essentially no bedding was visible, even using UV photography. However, extensive fluvial cross-bedding throughout the core was revealed by the x-radiography. A similar, heavy oil masking problem in a Temblor Formation core near East Coalinga was also resolved by the x-ray technique. The reservoir is divided into multiple, thin, tidal couplets (4-6 in.) of oil-saturated sand separated by 1 to 3 in. thick mudstones.« less
  • In recognizing the need for measuring and documenting the quality of environmental measurements obtained in its monitoring projects and for setting achievable data quality goals for such projects, the Environmental Protection Agency issues a number of guidance and informational documents addressed to those needs. This paper reviews one of those documents, a comprehensive compilation of the quality of measurements actually obtained with various environmental measurement methods in all environmental media. Included are a brief discussion of the rationale and purpose of the document, limited reviews of the four designated measures of data quality (precision, accuracy, completeness, and method detection limit),more » and explanations of the format used to list the data quality information. Examples of actual data listing from the document are also included. 5 references, 4 figures.« less