Distributed metadata in a high performance computing environment
A computer-executable method, system, and computer program product for managing meta-data in a distributed storage system, wherein the distributed storage system includes one or more burst buffers enabled to operate with a distributed key-value store, the co computer-executable method, system, and computer program product comprising receiving a request for meta-data associated with a block of data stored in a first burst buffer of the one or more burst buffers in the distributed storage system, wherein the meta data is associated with a key-value, determining which of the one or more burst buffers stores the requested metadata, and upon determination that a first burst buffer of the one or more burst buffers stores the requested metadata, locating the key-value in a portion of the distributed key-value store accessible from the first burst buffer.
- Research Organization:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC52-06NA25396
- Assignee:
- EMC IP Holding Company LLC
- Patent Number(s):
- 9,703,788
- Application Number:
- 14/230,800
- OSTI ID:
- 1369068
- Country of Publication:
- United States
- Language:
- English
Similar Records
Hybrid data storage system in an HPC exascale environment
Distributed metadata servers in a file system with separate metadata servers for file metadata and directory metadata