Methods and apparatus for multi-resolution replication of files in a parallel computing system using semantic information
Techniques are provided for storing files in a parallel computing system using different resolutions. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a sub-file. The method comprises the steps of obtaining semantic information related to the file; generating a plurality of replicas of the file with different resolutions based on the semantic information; and storing the file and the plurality of replicas of the file in one or more storage nodes of the parallel computing system. The different resolutions comprise, for example, a variable number of bits and/or a different sub-set of data elements from the file. A plurality of the sub-files can be merged to reproduce the file.
- Research Organization:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC52-06NA25396
- Assignee:
- EMC Corporation (Hopkinton, MA)
- Patent Number(s):
- 9,165,014
- Application Number:
- 13/536,358
- OSTI ID:
- 1223695
- Resource Relation:
- Patent File Date: 2012 Jun 28
- Country of Publication:
- United States
- Language:
- English
Systems and methods for managing portions of files in multi-tier storage systems
|
patent | January 2013 |
Managing resource storage for multi resolution imagery data with zoom level
|
patent | August 2013 |
Distributed file system and method of operating a distributed file system
|
patent-application | May 2006 |
| PLFS: a checkpoint filesystem for parallel applications | conference | January 2009 |
Similar Records
Storing files in a parallel computing system based on user-specified parser function
Storing files in a parallel computing system using list-based index to identify replica files