Distributed metadata servers in a file system with separate metadata servers for file metadata and directory metadata
Abstract
A file system is provided having a plurality of distributed metadata servers with separate metadata servers for file metadata and directory metadata. An exemplary distributed metadata storage system comprises a plurality of compute nodes, wherein at least one compute node comprises a file system client that generates a directory metadata request and/or a file metadata request; a plurality of directory metadata servers to serve directory metadata in response to a given directory metadata request; and a plurality of file metadata servers to serve file metadata in response to a given file metadata request. The plurality of directory metadata servers are distinct from the plurality of file metadata servers. The compute nodes optionally comprise an object client that requests object data from an object store system. The number of directory metadata servers and the number of file metadata servers are optionally determined independently to balance for different workloads, and can be dynamically readjusted for evolving workloads.
- Inventors:
- Issue Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1495211
- Patent Number(s):
- 10140304
- Application Number:
- 14/965,257
- Assignee:
- EMC IP Holding Company LLC (Hopkinton, MA); Los Alamos National Security, LLC (Los Alamos, NM)
- Patent Classifications (CPCs):
-
G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING
- DOE Contract Number:
- AC52-06NA25396
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 2015 Dec 10
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING
Citation Formats
Bent, John M., Faibish, Sorin, and Grider, Gary. Distributed metadata servers in a file system with separate metadata servers for file metadata and directory metadata. United States: N. p., 2018.
Web.
Bent, John M., Faibish, Sorin, & Grider, Gary. Distributed metadata servers in a file system with separate metadata servers for file metadata and directory metadata. United States.
Bent, John M., Faibish, Sorin, and Grider, Gary. Tue .
"Distributed metadata servers in a file system with separate metadata servers for file metadata and directory metadata". United States. https://www.osti.gov/servlets/purl/1495211.
@article{osti_1495211,
title = {Distributed metadata servers in a file system with separate metadata servers for file metadata and directory metadata},
author = {Bent, John M. and Faibish, Sorin and Grider, Gary},
abstractNote = {A file system is provided having a plurality of distributed metadata servers with separate metadata servers for file metadata and directory metadata. An exemplary distributed metadata storage system comprises a plurality of compute nodes, wherein at least one compute node comprises a file system client that generates a directory metadata request and/or a file metadata request; a plurality of directory metadata servers to serve directory metadata in response to a given directory metadata request; and a plurality of file metadata servers to serve file metadata in response to a given file metadata request. The plurality of directory metadata servers are distinct from the plurality of file metadata servers. The compute nodes optionally comprise an object client that requests object data from an object store system. The number of directory metadata servers and the number of file metadata servers are optionally determined independently to balance for different workloads, and can be dynamically readjusted for evolving workloads.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue Nov 27 00:00:00 EST 2018},
month = {Tue Nov 27 00:00:00 EST 2018}
}
Works referenced in this record:
Inode based policy identifiers in a filing system
patent, June 2010
- Goldick, Jonathan S.
- US Patent Document 7,743,038
Managing metadata
patent, January 2011
- Faibish, Sorin; Bixby, Peter; Gupta, Uday
- US Patent Document 7,873,619
Method and apparatus for providing a key-value based storage interface
patent, April 2014
- Cooney, Geoffrey Thomas; McCracken, Kenneth D.; Pan, Zane
- US Patent Document 8,700,683
System and method to maximize server resource utilization and performance of metadata operations
patent, November 2015
- Mysur, Kaushik Triyambaka; Lin, Wujuan; Ikeda, Hirokazu
- US Patent Document 9,197,703
Virtual file system providing interface between analytics platform and physical file system
patent, April 2016
- Faibish, Sorin; Bent, John M.; Tuma, George
- US Patent Document 9,305,010
Distributed metadata servers for cluster file systems using shared low latency persistent key-value metadata store
patent, December 2017
- Bent, John M.; Faibish, Sorin; Pedone, Jr., James M.
- US Patent Document 9,852,146
DualFS: a new journaling file system without meta-data duplication
conference, January 2002
- Piernas, Juan; Cortes, Toni; García, José M.
- Proceedings of the 16th international conference on Supercomputing - ICS '02