Final Report for File System Support for Burst Buffers on HPC Systems
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Distributed burst buffers are a promising storage architecture for handling I/O workloads for exascale computing. As they are being deployed on more supercomputers, a file system that efficiently manages these burst buffers for fast I/O operations carries great consequence. Over the past year, FSU team has undertaken several efforts to design, prototype and evaluate distributed file systems for burst buffers on HPC systems. These include MetaKV: a Key-Value Store for Metadata Management of Distributed Burst Buffers, a user-level file system with multiple backends, and a specialized file system for large datasets of deep neural networks. Our progress for these respective efforts are elaborated further in this report.
- Research Organization:
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC52-07NA27344
- OSTI ID:
- 1411671
- Report Number(s):
- LLNL-SR-742423
- Country of Publication:
- United States
- Language:
- English
Similar Records
Design and Implementation of Burst Buffer Over-Subscription Scheme for HPC Storage Systems
Evaluating Burst Buffer Placement in HPC Systems