BurstMem: A High-Performance Burst Buffer System for Scientific Applications

Conference · Wed Jan 01 00:00:00 EST 2014

DOI:https://doi.org/10.1109/BigData.2014.7004215· OSTI ID:1150929

Wang, Teng ^[1]; Oral, H Sarp ^[2]; Wang, Yandong ^[1]; Settlemyer, Bradley W ^[2]; Atchley, Scott ^[2]; Yu, Weikuan ^[1]

---

1. Auburn University, Auburn, Alabama
2. ORNL

The growth of computing power on large-scale sys- tems requires commensurate high-bandwidth I/O system. Many parallel file systems are designed to provide fast sustainable I/O in response to applications soaring requirements. To meet this need, a novel system is imperative to temporarily buffer the bursty I/O and gradually flush datasets to long-term parallel file systems. In this paper, we introduce the design of BurstMem, a high- performance burst buffer system. BurstMem provides a storage framework with efficient storage and communication manage- ment strategies. Our experiments demonstrate that BurstMem is able to speed up the I/O performance of scientific applications by up to 8.5 on leadership computer systems.

• Research Organization: Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
• Sponsoring Organization: USDOE
• DOE Contract Number: DE-AC05-00OR22725
• OSTI ID: 1150929
• Resource Relation: Conference: IEEE BigData, Washington DC, DC, USA, 20141027, 20141027
• Country of Publication: United States
• Language: English