skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data

Patent ·
OSTI ID:1213443
;

Collective buffering and data pattern solutions are provided for storage, retrieval, and/or analysis of data in a collective parallel processing environment. For example, a method can be provided for data storage in a collective parallel processing environment. The method comprises receiving data to be written for a plurality of collective processes within a collective parallel processing environment, extracting a data pattern for the data to be written for the plurality of collective processes, generating a representation describing the data pattern, and saving the data and the representation.

Research Organization:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Organization:
USDOE
DOE Contract Number:
AC52-06NA25396
Assignee:
Los Alamos National Security, LLC (Los Alamos, NM)
Patent Number(s):
9,122,700
Application Number:
13/722,946
OSTI ID:
1213443
Resource Relation:
Patent File Date: 2012 Dec 20
Country of Publication:
United States
Language:
English

References (9)

Buffering a hierarchical index of multi-dimensional data patent October 2002
Portable electronic device having a log-structured file system in flash memory patent March 2003
File conversion system and method patent March 2010
Method and system for offline indexing of content and classifying stored data patent February 2011
Method and system for performing logical partial declustering patent August 2011
Self-compacting pattern indexer: storing, indexing and accessing information in a graph-like data structure patent November 2011
Order preservation in data parallel operations patent December 2011
Distributed file system and method of operating a distributed file system patent-application May 2006
EDO: Improving Read Performance for Scientific Applications through Elastic Data Organization conference September 2011

Cited By (1)

Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data patent September 2015

Similar Records

PARLO: PArallel Run-Time Layout Optimization for Scientific Data Explorations with Heterogeneous Access Pattern
Conference · Tue Jan 01 00:00:00 EST 2013 · OSTI ID:1213443
+5 more
Parallel compression of data chunks of a shared data object using a log-structured file system
Patent · Tue Oct 25 00:00:00 EDT 2016 · OSTI ID:1213443
PARLO: PArallel Run-Time Layout Optimization for Scientific Data Explorations with Heterogeneous Access Patterns
Conference · Tue Jun 25 00:00:00 EDT 2013 · PROCEEDINGS OF THE 2013 13TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID 2013) · OSTI ID:1213443
+5 more

Related Subjects

96 KNOWLEDGE MANAGEMENT AND PRESERVATION