It’s Time to Talk About HPC Storage: Perspectives on the Past and Future

Journal Article · Mon Nov 01 00:00:00 EDT 2021 · Computing in Science and Engineering

DOI:https://doi.org/10.1109/mcse.2021.3117353· OSTI ID:1995506

Settlemyer, Bradley ^[1]; Amvrosiadis, George ^[2]; Carns, Philip ^[3]; Ross, Robert ^[3]

---

1. Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
2. Carnegie Mellon University, Pittsburgh, PA (United States)
3. Argonne National Laboratory (ANL), Argonne, IL (United States)

High-performance computing (HPC) storage systems are a key component of the success of HPC to date. Recently, we have seen major developments in storage-related technologies, as well as changes to how HPC platforms are used, especially in relation to artificial intelligence and experimental data analysis workloads. Additionally, these developments merit a revisit of HPC storage system architectural designs. In this article, we discuss the drivers, identify key challenges to status quo posed by these developments, and discuss directions future research might take to unlock the potential of new technologies for the breadth of HPC applications.

• Research Organization: Argonne National Laboratory (ANL), Argonne, IL (United States)
• Sponsoring Organization: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
• Grant/Contract Number: AC02-06CH11357
• OSTI ID: 1995506
• Journal Information: Computing in Science and Engineering, Journal Name: Computing in Science and Engineering Journal Issue: 6 Vol. 23; ISSN 1521-9615
• Publisher: IEEE Computer Society
• Country of Publication: United States
• Language: English

Related Subjects

97 MATHEMATICS AND COMPUTING
HPC storage system architectural designs
artificial intelligence
experimental data analysis workloads
high-performance computing storage systems
parallel processing
storage allocation
storage-related technologies