DOE Patents title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Distributed metadata in a high performance computing environment

Abstract

A computer-executable method, system, and computer program product for managing meta-data in a distributed storage system, wherein the distributed storage system includes one or more burst buffers enabled to operate with a distributed key-value store, the co computer-executable method, system, and computer program product comprising receiving a request for meta-data associated with a block of data stored in a first burst buffer of the one or more burst buffers in the distributed storage system, wherein the meta data is associated with a key-value, determining which of the one or more burst buffers stores the requested metadata, and upon determination that a first burst buffer of the one or more burst buffers stores the requested metadata, locating the key-value in a portion of the distributed key-value store accessible from the first burst buffer.

Inventors:
; ; ; ;
Issue Date:
Research Org.:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1369068
Patent Number(s):
9703788
Application Number:
14/230,800
Assignee:
EMC IP Holding Company LLC
Patent Classifications (CPCs):
G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING
DOE Contract Number:  
AC52-06NA25396
Resource Type:
Patent
Resource Relation:
Patent File Date: 2014 Mar 31
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING

Citation Formats

Bent, John M., Faibish, Sorin, Zhang, Zhenhua, Liu, Xuezhao, and Tang, Haiying. Distributed metadata in a high performance computing environment. United States: N. p., 2017. Web.
Bent, John M., Faibish, Sorin, Zhang, Zhenhua, Liu, Xuezhao, & Tang, Haiying. Distributed metadata in a high performance computing environment. United States.
Bent, John M., Faibish, Sorin, Zhang, Zhenhua, Liu, Xuezhao, and Tang, Haiying. Tue . "Distributed metadata in a high performance computing environment". United States. https://www.osti.gov/servlets/purl/1369068.
@article{osti_1369068,
title = {Distributed metadata in a high performance computing environment},
author = {Bent, John M. and Faibish, Sorin and Zhang, Zhenhua and Liu, Xuezhao and Tang, Haiying},
abstractNote = {A computer-executable method, system, and computer program product for managing meta-data in a distributed storage system, wherein the distributed storage system includes one or more burst buffers enabled to operate with a distributed key-value store, the co computer-executable method, system, and computer program product comprising receiving a request for meta-data associated with a block of data stored in a first burst buffer of the one or more burst buffers in the distributed storage system, wherein the meta data is associated with a key-value, determining which of the one or more burst buffers stores the requested metadata, and upon determination that a first burst buffer of the one or more burst buffers stores the requested metadata, locating the key-value in a portion of the distributed key-value store accessible from the first burst buffer.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue Jul 11 00:00:00 EDT 2017},
month = {Tue Jul 11 00:00:00 EDT 2017}
}

Works referenced in this record:

Message Flow Control in a Multi-Node Computer System
patent-application, December 2009


Policy-Based Storage Structure Distribution
patent-application, March 2011


Query Execution Systems and Methods
patent-application, December 2011


Scalable Distributed Metadata File System using Key-Value Stores
patent-application, November 2012


Active Non-Volatile Memory Post-Processing
patent-application, August 2013


Distributed Object Storage System Comprising Performance Optimizations
patent-application, October 2013


Load Balancing for Distributed Key-Value Store
patent-application, December 2013


Data Storage Architecture and System For High Performance Computing
patent-application, April 2014


System and Method for Compressing Data in a Database
patent-application, September 2014


Systems and Methods For Implementing Distributed Databases Using Many-Core Processors
patent-application, September 2014


Method and System For Data Transfer Between Compute Clusters And File System
patent-application, November 2014


Read Operations In A Tree-Based Distributed File System
patent-application, February 2016