Skip to main content
OSTI.GOVU.S. Department of Energy Office of Scientific and Technical Information
U.S. Department of Energy
Office of Scientific and Technical Information
 

HPC I/O innovations in the exascale era

Journal Article · · International Journal of High Performance Computing Applications
 [1];  [2];  [2];  [2];  [3];  [4];  [2];  [2];  [2];  [5];  [4];  [6];  [4];  [3]
  1. Georgia Institute of Technology, Atlanta, GA (United States)
  2. Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
  3. Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
  4. Kitware, Inc., Clifton Park, NY (United States)
  5. New Jersey Institute of Technology (NJIT), Newark, NJ (United States)
  6. Georgia State Univ., Atlanta, GA (United States)
+ Show Author Affiliations

As high performance computing architecture evolves to deliver ever-increasing performance, the middleware tools also need to adapt in order for applications to better use these higher-performance features. Here, the Adaptable Input Output System (ADIOS), which provides scalable IO performance for exascale HPC applications is one such middleware. During the Exascale Computing Project (ECP), key portions of the ADIOS environment were adapted to respond to ongoing developments in exascale computing and the stresses and opportunities inherent in those changes. This paper examines those changes and where appropriate compares them to pre-exascale implementations.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
3002498
Alternate ID(s):
OSTI ID: 2549446
Journal Information:
International Journal of High Performance Computing Applications, Journal Name: International Journal of High Performance Computing Applications Journal Issue: 4 Vol. 39; ISSN 1094-3420; ISSN 1741-2846
Publisher:
SAGECopyright Statement
Country of Publication:
United States
Language:
English

References (24)

Hello ADIOS: the challenges and lessons of developing leadership class I/O frameworks: HELLO ADIOS journal August 2013
Boost C++ Libraries book January 2010
DAOS: A Scale-Out High Performance Storage Stack for Storage Class Memory book January 2020
ADIOS 2: The Adaptable Input Output System. A framework for high-performance data management journal July 2020
MGARD: A multigrid framework for high-performance, error-controlled data compression and refactoring journal December 2023
Spatial core-edge coupling of the particle-in-cell gyrokinetic codes GEM and XGC journal December 2020
First coupled GENE–XGC microturbulence simulations journal January 2021
Global adjoint tomography: first-generation model journal September 2016
EDO: Improving Read Performance for Scientific Applications through Elastic Data Organization conference September 2011
VeloC: Towards High Performance Adaptive Asynchronous Checkpointing at Large Scale conference May 2019
mdspan in C++: A Case Study in the Integration of Performance Portable Features into International Language Standards conference November 2019
Parallel netCDF: A High-Performance Scientific I/O Interface conference November 2003
Design, Modeling, and Evaluation of a Scalable Multi-level Checkpointing System
  • Moody, Adam; Bronevetsky, Greg; Mohror, Kathryn
  • 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.18
conference November 2010
Pushing the Frontier in the Design of Laser-Based Electron Accelerators with Groundbreaking Mesh-Refined Particle-In-Cell Simulations on Exascale-Class Supercomputers conference November 2022
Kokkos 3: Programming Model Extensions for the Exascale Era journal January 2021
Improving I/O Performance for Exascale Applications Through Online Data Layout Reorganization journal April 2022
A Type System for High Performance Communication and Computation conference December 2011
Error Analysis of ZFP Compression for Floating-Point Data journal January 2019
Event-based systems: opportunities and challenges at exascale conference January 2009
...and eat it too: high read performance in write-optimized HPC I/O middleware file formats conference January 2009
Enhancing Metadata Transfer Efficiency: Unlocking the Potential of DAOS in the ADIOS context
  • Sarpangala Venkatesh, Ranjan; Eisenhauer, Greg; Klasky, Scott
  • Proceedings of the SC '23 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis https://doi.org/10.1145/3624062.3624193
conference November 2023
Terascale High-Fidelity Simulations of Turbulent Combustion with Detailed Chemistry report August 2012
openPMD 1.1.0: Base paths for mesh- and particle-only files and updated attributes software February 2018
Zarr journal September 2023

Similar Records

MAGMA: Enabling exascale performance with accelerated BLAS and LAPACK for diverse GPU architectures
Journal Article · Thu Jun 20 00:00:00 EDT 2024 · International Journal of High Performance Computing Applications · OSTI ID:2375895
On the energy footprint of I/O management in Exascale HPC systems
Journal Article · Mon Mar 21 00:00:00 EDT 2016 · Future Generations Computer Systems · OSTI ID:1390829

Related Subjects

ADIOS
High Performance Computing
I/O