Distributed metadata in a high performance computing environment
Abstract
A computer-executable method, system, and computer program product for managing meta-data in a distributed storage system, wherein the distributed storage system includes one or more burst buffers enabled to operate with a distributed key-value store, the co computer-executable method, system, and computer program product comprising receiving a request for meta-data associated with a block of data stored in a first burst buffer of the one or more burst buffers in the distributed storage system, wherein the meta data is associated with a key-value, determining which of the one or more burst buffers stores the requested metadata, and upon determination that a first burst buffer of the one or more burst buffers stores the requested metadata, locating the key-value in a portion of the distributed key-value store accessible from the first burst buffer.
- Inventors:
- Issue Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1369068
- Patent Number(s):
- 9703788
- Application Number:
- 14/230,800
- Assignee:
- EMC IP Holding Company LLC
- Patent Classifications (CPCs):
-
G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING
- DOE Contract Number:
- AC52-06NA25396
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 2014 Mar 31
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING
Citation Formats
Bent, John M., Faibish, Sorin, Zhang, Zhenhua, Liu, Xuezhao, and Tang, Haiying. Distributed metadata in a high performance computing environment. United States: N. p., 2017.
Web.
Bent, John M., Faibish, Sorin, Zhang, Zhenhua, Liu, Xuezhao, & Tang, Haiying. Distributed metadata in a high performance computing environment. United States.
Bent, John M., Faibish, Sorin, Zhang, Zhenhua, Liu, Xuezhao, and Tang, Haiying. Tue .
"Distributed metadata in a high performance computing environment". United States. https://www.osti.gov/servlets/purl/1369068.
@article{osti_1369068,
title = {Distributed metadata in a high performance computing environment},
author = {Bent, John M. and Faibish, Sorin and Zhang, Zhenhua and Liu, Xuezhao and Tang, Haiying},
abstractNote = {A computer-executable method, system, and computer program product for managing meta-data in a distributed storage system, wherein the distributed storage system includes one or more burst buffers enabled to operate with a distributed key-value store, the co computer-executable method, system, and computer program product comprising receiving a request for meta-data associated with a block of data stored in a first burst buffer of the one or more burst buffers in the distributed storage system, wherein the meta data is associated with a key-value, determining which of the one or more burst buffers stores the requested metadata, and upon determination that a first burst buffer of the one or more burst buffers stores the requested metadata, locating the key-value in a portion of the distributed key-value store accessible from the first burst buffer.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue Jul 11 00:00:00 EDT 2017},
month = {Tue Jul 11 00:00:00 EDT 2017}
}
Works referenced in this record:
Storing and retrieving objects on a computer network in a distributed database
patent, April 2009
- Meadway, Mike; Tharp, Stanford
- US Patent Document 7,523,130
Message Flow Control in a Multi-Node Computer System
patent-application, December 2009
- Barsness, Eric L.; Darrington, David L.; Peters, Amanda
- US Patent Application 12/144783; 20090319621
Policy-Based Storage Structure Distribution
patent-application, March 2011
- Moyne, Jean-Noel; Subramani, Suresh; Kim, Tom M.
- US Patent Application 12/762249; 20110066591
Query Execution Systems and Methods
patent-application, December 2011
- Abadi, Daniel; Bajda-Pawlikowski, Kamil
- US Patent Application 13/032551; 20110302151
Scalable Distributed Metadata File System using Key-Value Stores
patent-application, November 2012
- Dalton, Michael W.
- US Patent Application 13/455891; 20120284317
Active Non-Volatile Memory Post-Processing
patent-application, August 2013
- Kannan, Sudarsun; Milojicic, Dejan S.; Talwar, Vanish
- US Patent Application 13/404619; 20130227194
Distributed Object Storage System Comprising Performance Optimizations
patent-application, October 2013
- De Schrijvr, Frederik; Slootmaekers, Romain Raymond Agnes; Stougie, Bastiaan
- US Patent Application 13/976061; 20130275381
Load Balancing for Distributed Key-Value Store
patent-application, December 2013
- Shiga, Kenta; Lin, Wujuan
- US Patent Application 13/489897; 20130332608
Data Storage Architecture and System For High Performance Computing
patent-application, April 2014
- Nowoczynski, Paul; Cope, Jason Micah; Manning, Gordon
- US Patent Application 14/028292; 20140108707
System and Method for Compressing Data in a Database
patent-application, September 2014
- Velury, Ramabrahmam; Tan, Jihui; Zhou, Guangcheng
- US Patent Application 13/804321; 20140279964
Systems and Methods For Implementing Distributed Databases Using Many-Core Processors
patent-application, September 2014
- Rawson, Ryan; Newman, Alexander
- US Patent Document 14/209454; 20140280375
Method and System For Data Transfer Between Compute Clusters And File System
patent-application, November 2014
- Uppu, Pavan Kumar; Cope, Jason Micah; Nowoczynski, Paul
- US Patent Application14/045170; 20140351300
Read Operations In A Tree-Based Distributed File System
patent-application, February 2016
- Aron, Mohit; Shanmuganathan, Ganesha
- US Patent Application 14/450798; 20160034507