Skip to main content
OSTI.GOVU.S. Department of Energy Office of Scientific and Technical Information
U.S. Department of Energy
Office of Scientific and Technical Information
 

Accelerating Science with the NERSC Burst Buffer Early User Program

Conference ·
OSTI ID:1393591
 [1];  [1];  [2];  [1];  [1];  [1];  [1];  [1];  [1];  [1];  [1];  [1];  [3];  [1];  [1];  [1];  [1];  [1];  [1];  [1] more »;  [1];  [1] « less
  1. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
  2. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States); Rutgers Univ., New Brunswick, NJ (United States)
  3. Argonne National Lab. (ANL), Argonne, IL (United States). Advanced Photon Source (APS)
+ Show Author Affiliations
NVRAM-based Burst Buffers are an important part of the emerging HPC storage landscape. The National Energy Research Scientific Computing Center (NERSC) at Lawrence Berkeley National Laboratory recently installed one of the first Burst Buffer systems as part of its new Cori supercomputer, collaborating with Cray on the development of the DataWarp software. NERSC has a diverse user base comprised of over 6500 users in 700 different projects spanning a wide variety of scientific computing applications. The use-cases of the Burst Buffer at NERSC are therefore also considerable and diverse. We describe here performance measurements and lessons learned from the Burst Buffer Early User Program at NERSC, which selected a number of research projects to gain early access to the Burst Buffer and exercise its capability to enable new scientific advancements. To the best of our knowledge this is the first time a Burst Buffer has been stressed at scale by diverse, real user workloads and therefore these lessons will be of considerable benefit to shaping the developing use of Burst Buffers at HPC centers.
Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
DOE Contract Number:
AC02-05CH11231
OSTI ID:
1393591
Country of Publication:
United States
Language:
English

Similar Records

An empirical study of I/O separation for burst buffers in HPC systems
Journal Article · Sat Oct 31 20:00:00 EDT 2020 · Journal of Parallel and Distributed Computing · OSTI ID:1766544
Towards understanding HPC users and systems: A NERSC case study
Journal Article · Wed Sep 13 20:00:00 EDT 2017 · Journal of Parallel and Distributed Computing · OSTI ID:1439236
Large Scale Computing and Storage Requirements for Basic Energy Sciences: Target 2017. Report of the NERSC Requirements Review Conducted October 8–9, 2013, Gathersburg, MD
Technical Report · Wed Oct 01 00:00:00 EDT 2014 · OSTI ID:1471098

Related Subjects

97 MATHEMATICS AND COMPUTING