Global to push GA events into
skip to main content

Title: Cloud object store for archive storage of high performance computing data using decoupling middleware

Cloud object storage is enabled for archived data, such as checkpoints and results, of high performance computing applications using a middleware process. A plurality of archived files, such as checkpoint files and results, generated by a plurality of processes in a parallel computing system are stored by obtaining the plurality of archived files from the parallel computing system; converting the plurality of archived files to objects using a log structured file system middleware process; and providing the objects for storage in a cloud object storage system. The plurality of processes may run, for example, on a plurality of compute nodes. The log structured file system middleware process may be embodied, for example, as a Parallel Log-Structured File System (PLFS). The log structured file system middleware process optionally executes on a burst buffer node.
Inventors:
; ;
Issue Date:
OSTI Identifier:
1187939
Assignee:
Los Alamos National Security, LLC (Los Alamos, NM) LANL
Patent Number(s):
9,069,778
Application Number:
13/730,097
Contract Number:
AC52-06NA25396
Resource Relation:
Patent File Date: 2012 Dec 28
Research Org:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Org:
USDOE
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING

Other works cited in this record:

PLFS: a checkpoint filesystem for parallel applications
conference, January 2009

The design and implementation of a log-structured file system
journal, February 1992
  • Rosenblum, Mendel; Ousterhout, John K.
  • ACM Transactions on Computer Systems, Vol. 10, Issue 1, p. 26-52
  • DOI: 10.1145/146941.146943

Similar records in DOepatents and OSTI.GOV collections: