skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Methods and apparatus for multi-resolution replication of files in a parallel computing system using semantic information

Abstract

Techniques are provided for storing files in a parallel computing system using different resolutions. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a sub-file. The method comprises the steps of obtaining semantic information related to the file; generating a plurality of replicas of the file with different resolutions based on the semantic information; and storing the file and the plurality of replicas of the file in one or more storage nodes of the parallel computing system. The different resolutions comprise, for example, a variable number of bits and/or a different sub-set of data elements from the file. A plurality of the sub-files can be merged to reproduce the file.

Inventors:
; ; ; ;
Publication Date:
Research Org.:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1223695
Patent Number(s):
9,165,014
Application Number:
13/536,358
Assignee:
EMC Corporation (Hopkinton, MA) LANL
DOE Contract Number:  
AC52-06NA25396
Resource Type:
Patent
Resource Relation:
Patent File Date: 2012 Jun 28
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING

Citation Formats

Faibish, Sorin, Bent, John M., Tzelnic, Percy, Grider, Gary, and Torres, Aaron. Methods and apparatus for multi-resolution replication of files in a parallel computing system using semantic information. United States: N. p., 2015. Web.
Faibish, Sorin, Bent, John M., Tzelnic, Percy, Grider, Gary, & Torres, Aaron. Methods and apparatus for multi-resolution replication of files in a parallel computing system using semantic information. United States.
Faibish, Sorin, Bent, John M., Tzelnic, Percy, Grider, Gary, and Torres, Aaron. Tue . "Methods and apparatus for multi-resolution replication of files in a parallel computing system using semantic information". United States. doi:. https://www.osti.gov/servlets/purl/1223695.
@article{osti_1223695,
title = {Methods and apparatus for multi-resolution replication of files in a parallel computing system using semantic information},
author = {Faibish, Sorin and Bent, John M. and Tzelnic, Percy and Grider, Gary and Torres, Aaron},
abstractNote = {Techniques are provided for storing files in a parallel computing system using different resolutions. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a sub-file. The method comprises the steps of obtaining semantic information related to the file; generating a plurality of replicas of the file with different resolutions based on the semantic information; and storing the file and the plurality of replicas of the file in one or more storage nodes of the parallel computing system. The different resolutions comprise, for example, a variable number of bits and/or a different sub-set of data elements from the file. A plurality of the sub-files can be merged to reproduce the file.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue Oct 20 00:00:00 EDT 2015},
month = {Tue Oct 20 00:00:00 EDT 2015}
}

Patent:

Save / Share:

Works referenced in this record:

PLFS: a checkpoint filesystem for parallel applications
conference, January 2009