Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data
Abstract
Collective buffering and data pattern solutions are provided for storage, retrieval, and/or analysis of data in a collective parallel processing environment. For example, a method can be provided for data storage in a collective parallel processing environment. The method comprises receiving data to be written for a plurality of collective processes within a collective parallel processing environment, extracting a data pattern for the data to be written for the plurality of collective processes, generating a representation describing the data pattern, and saving the data and the representation.
- Inventors:
- Issue Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1213443
- Patent Number(s):
- 9122700
- Application Number:
- 13/722,946
- Assignee:
- Los Alamos National Security, LLC (Los Alamos, NM)
- Patent Classifications (CPCs):
-
G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING
- DOE Contract Number:
- AC52-06NA25396
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 2012 Dec 20
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 96 KNOWLEDGE MANAGEMENT AND PRESERVATION
Citation Formats
Grider, Gary A., and Poole, Stephen W. Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data. United States: N. p., 2015.
Web.
Grider, Gary A., & Poole, Stephen W. Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data. United States.
Grider, Gary A., and Poole, Stephen W. Tue .
"Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data". United States. https://www.osti.gov/servlets/purl/1213443.
@article{osti_1213443,
title = {Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data},
author = {Grider, Gary A. and Poole, Stephen W.},
abstractNote = {Collective buffering and data pattern solutions are provided for storage, retrieval, and/or analysis of data in a collective parallel processing environment. For example, a method can be provided for data storage in a collective parallel processing environment. The method comprises receiving data to be written for a plurality of collective processes within a collective parallel processing environment, extracting a data pattern for the data to be written for the plurality of collective processes, generating a representation describing the data pattern, and saving the data and the representation.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue Sep 01 00:00:00 EDT 2015},
month = {Tue Sep 01 00:00:00 EDT 2015}
}
Works referenced in this record:
Buffering a hierarchical index of multi-dimensional data
patent, October 2002
- Kothuri, Ravi; Ravada, Siva; Sharma, Jayant
- US Patent Document 6,470,344
Portable electronic device having a log-structured file system in flash memory
patent, March 2003
- Parker, Kenneth
- US Patent Document 6,535,949
File conversion system and method
patent, March 2010
- Tsykora, Anatoliy V.
- US Patent Document 7,681,122
Method and system for offline indexing of content and classifying stored data
patent, February 2011
- Gokhale, Parag; Kottomtharayil, Rajiv; Attarde, Deepak Raghunath
- US Patent Document 7,882,077
Method and system for performing logical partial declustering
patent, August 2011
- Ramesh, Bhashyam; Watzke, Michael W.
- US Patent Document 8,005,836
Self-compacting pattern indexer: storing, indexing and accessing information in a graph-like data structure
patent, November 2011
- Mukerjee, Kunal; Thompson, III, R. Donald; Cole, Jeffrey
- US Patent Document 8,065,293
Order preservation in data parallel operations
patent, December 2011
- Duffy, John; Callahan, David; Essey, Edward G.
- US Patent Document 8,074,219
Distributed file system and method of operating a distributed file system
patent-application, May 2006
- Tichy, Walter; Isaila, Florin
- US Patent Application 10/491459; 20060101025
EDO: Improving Read Performance for Scientific Applications through Elastic Data Organization
conference, September 2011
- Tian, Yuan; Klasky, Scott; Abbasi, Hasan
- 2011 IEEE International Conference on Cluster Computing (CLUSTER)
Works referencing / citing this record:
Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data
patent, September 2015
- Grider, Gary; Poole, Stephen W.
- US Patent Document 9,122,700