DOE Patents title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data

Abstract

Collective buffering and data pattern solutions are provided for storage, retrieval, and/or analysis of data in a collective parallel processing environment. For example, a method can be provided for data storage in a collective parallel processing environment. The method comprises receiving data to be written for a plurality of collective processes within a collective parallel processing environment, extracting a data pattern for the data to be written for the plurality of collective processes, generating a representation describing the data pattern, and saving the data and the representation.

Inventors:
;
Issue Date:
Research Org.:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1213443
Patent Number(s):
9122700
Application Number:
13/722,946
Assignee:
Los Alamos National Security, LLC (Los Alamos, NM)
Patent Classifications (CPCs):
G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING
DOE Contract Number:  
AC52-06NA25396
Resource Type:
Patent
Resource Relation:
Patent File Date: 2012 Dec 20
Country of Publication:
United States
Language:
English
Subject:
96 KNOWLEDGE MANAGEMENT AND PRESERVATION

Citation Formats

Grider, Gary A., and Poole, Stephen W. Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data. United States: N. p., 2015. Web.
Grider, Gary A., & Poole, Stephen W. Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data. United States.
Grider, Gary A., and Poole, Stephen W. Tue . "Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data". United States. https://www.osti.gov/servlets/purl/1213443.
@article{osti_1213443,
title = {Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data},
author = {Grider, Gary A. and Poole, Stephen W.},
abstractNote = {Collective buffering and data pattern solutions are provided for storage, retrieval, and/or analysis of data in a collective parallel processing environment. For example, a method can be provided for data storage in a collective parallel processing environment. The method comprises receiving data to be written for a plurality of collective processes within a collective parallel processing environment, extracting a data pattern for the data to be written for the plurality of collective processes, generating a representation describing the data pattern, and saving the data and the representation.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue Sep 01 00:00:00 EDT 2015},
month = {Tue Sep 01 00:00:00 EDT 2015}
}

Works referenced in this record:

Buffering a hierarchical index of multi-dimensional data
patent, October 2002


File conversion system and method
patent, March 2010


Method and system for offline indexing of content and classifying stored data
patent, February 2011


Method and system for performing logical partial declustering
patent, August 2011


Order preservation in data parallel operations
patent, December 2011


Distributed file system and method of operating a distributed file system
patent-application, May 2006


EDO: Improving Read Performance for Scientific Applications through Elastic Data Organization
conference, September 2011