Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data
Abstract
Collective buffering and data pattern solutions are provided for storage, retrieval, and/or analysis of data in a collective parallel processing environment. For example, a method can be provided for data storage in a collective parallel processing environment. The method comprises receiving data to be written for a plurality of collective processes within a collective parallel processing environment, extracting a data pattern for the data to be written for the plurality of collective processes, generating a representation describing the data pattern, and saving the data and the representation.
- Inventors:
- Issue Date:
- Research Org.:
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1213443
- Patent Number(s):
- 9,122,700
- Application Number:
- 13/722,946
- Assignee:
- Los Alamos National Security, LLC (Los Alamos, NM)
- DOE Contract Number:
- AC52-06NA25396
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 2012 Dec 20
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 96 KNOWLEDGE MANAGEMENT AND PRESERVATION
Citation Formats
Grider, Gary A., and Poole, Stephen W. Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data. United States: N. p., 2015.
Web.
Grider, Gary A., & Poole, Stephen W. Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data. United States.
Grider, Gary A., and Poole, Stephen W. Tue .
"Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data". United States. https://www.osti.gov/servlets/purl/1213443.
@article{osti_1213443,
title = {Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data},
author = {Grider, Gary A. and Poole, Stephen W.},
abstractNote = {Collective buffering and data pattern solutions are provided for storage, retrieval, and/or analysis of data in a collective parallel processing environment. For example, a method can be provided for data storage in a collective parallel processing environment. The method comprises receiving data to be written for a plurality of collective processes within a collective parallel processing environment, extracting a data pattern for the data to be written for the plurality of collective processes, generating a representation describing the data pattern, and saving the data and the representation.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2015},
month = {9}
}
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
EDO: Improving Read Performance for Scientific Applications through Elastic Data Organization
conference, September 2011
- Tian, Yuan; Klasky, Scott; Abbasi, Hasan
- 2011 IEEE International Conference on Cluster Computing (CLUSTER)