Metadata compression
Abstract
A computer-executable method, system, and computer program product for managing a Parallel-Logged File System (PLFS) on a data storage system, wherein the data storage system is in communication with an application that updates the data storage system with checkpoint data, the computer-executable method, system, and computer program product comprising receiving a first checkpoint including data from the application; analyzing the data in the first checkpoint to determine whether a pattern exists in the checkpoint data; and upon a positive determination, adding the pattern into PLFS.
- Inventors:
- Issue Date:
- Research Org.:
- EMC IP Holding Company LLC, Hopkinton, MA (United States); Triad National Security, LLC, Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE National Nuclear Security Administration (NNSA)
- OSTI Identifier:
- 1632548
- Patent Number(s):
- 10558618
- Application Number:
- 14/041,872
- Assignee:
- EMC IP Holding Company LLC (Hopkinton, MA); Triad National Security, LLC (Los Alamos, NM)
- Patent Classifications (CPCs):
-
G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING
- DOE Contract Number:
- 89233218CNA000001
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 09/30/2013
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING
Citation Formats
Bent, John M., Faibish, Sorin, Zhang, Zhenhua, He, Jun, Torres, Aaron, and Grider, Gary. Metadata compression. United States: N. p., 2020.
Web.
Bent, John M., Faibish, Sorin, Zhang, Zhenhua, He, Jun, Torres, Aaron, & Grider, Gary. Metadata compression. United States.
Bent, John M., Faibish, Sorin, Zhang, Zhenhua, He, Jun, Torres, Aaron, and Grider, Gary. Tue .
"Metadata compression". United States. https://www.osti.gov/servlets/purl/1632548.
@article{osti_1632548,
title = {Metadata compression},
author = {Bent, John M. and Faibish, Sorin and Zhang, Zhenhua and He, Jun and Torres, Aaron and Grider, Gary},
abstractNote = {A computer-executable method, system, and computer program product for managing a Parallel-Logged File System (PLFS) on a data storage system, wherein the data storage system is in communication with an application that updates the data storage system with checkpoint data, the computer-executable method, system, and computer program product comprising receiving a first checkpoint including data from the application; analyzing the data in the first checkpoint to determine whether a pattern exists in the checkpoint data; and upon a positive determination, adding the pattern into PLFS.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2020},
month = {2}
}
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Data compression method and apparatus
patent, December 1998
- Wightman, Andrew Thomas
- US Patent Document 5,850,565
Discovering Structure in Unstructured I/O
conference, November 2012
- He, Jun; Bent, John; Torres, Aaron
PLFS: a checkpoint filesystem for parallel applications
conference, January 2009
- Bent, John; Gibson, Garth; Grider, Gary
Architecture and method for a burst buffer using flash technology
patent, March 2016
- Tzelnic, Percy; Faibish, Sorin; Gupta, Uday
- US Patent Document 9,286,261
DataMods: Programmable File System Services
conference, November 2012
- Watkins, Noah; Maltzahn, Carlos; Brandt, Scott
- 2012 SC Companion: High Performance Computing, Networking Storage and Analysis
...and eat it too: high read performance in write-optimized HPC I/O middleware file formats
conference, January 2009
- Polte, Milo; Wingate, Meghan; Wolf, Matthew
- Proceedings of the 4th Annual Workshop on Petascale Data Storage - PDSW '09