skip to main content

SciTech ConnectSciTech Connect

Title: Versioning Complex Data

Using the history of ARM data files, we designed and demonstrated a data versioning paradigm that is feasible. Assigning versions to sets of files that are modified with some special assumptions and domain specific rules was effective in the case of ARM data, which has more than 5000 datastreams and 500TB of data.
Authors:
; ;
Publication Date:
OSTI Identifier:
1213019
Report Number(s):
PNNL-SA-99188
KP1704010
DOE Contract Number:
AC05-76RL01830
Resource Type:
Conference
Resource Relation:
Conference: IEEE International Congress on Big Data (BigData Congress 2014), June 27-July 2, 2014, Anchorage, Alaska, 788-791
Publisher:
Institute of Electrical and Electronics Engineers, Piscataway, NJ, United States(US).
Research Org:
Pacific Northwest National Laboratory (PNNL), Richland, WA (US)
Sponsoring Org:
USDOE
Country of Publication:
United States
Language:
English
Subject:
ARM; metadata; version; data management