skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Data Management Challenges of Exascale Scientific Simulations: A Case Study with the Gyrokinetic Toroidal Code and ADIOS

Abstract

The push towards exascale computing and the recent introduction of multi-petascale supercomputers have enabled science applications to run complex simulations. However, the gap between compute and I/O has grown wider, even as applications seek to generate and persist increasing amounts of data. Optimizing I/O is challenging and remains a bottleneck at scale. In this paper, we present initial I/O performance results of running Gyrokinetic Toroidal Code (GTC) on Summit, a 200 Petaflop system at Oak Ridge National Laboratory. To manage the complex data in GTC, we use ADIOS, an I/O and data management middleware that provides a rich set of APIs to manage and interact with scientific data. We discuss optimizations performed to obtain improvements in I/O performance and identify a set of challenges that will drive the design and development of next generation data management libraries.

Authors:
ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1];  [2];  [2];  [2];  [3]
  1. ORNL
  2. University of California Irvine
  3. University of California, Irvine
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1558473
DOE Contract Number:  
AC05-00OR22725
Resource Type:
Conference
Resource Relation:
Conference: 10th International Conference on Computational Methods (ICCM 2019) - Singapore, , Singapore - 7/9/2019 8:00:00 AM-7/13/2019 8:00:00 AM
Country of Publication:
United States
Language:
English

Citation Formats

Wan, Lipeng, Mehta, Kshitij V., Klasky, Scott A., Wolf, Matthew D., Wang, H Y., Wang, W H., Li, J C., and Lin, Zhihong. Data Management Challenges of Exascale Scientific Simulations: A Case Study with the Gyrokinetic Toroidal Code and ADIOS. United States: N. p., 2019. Web.
Wan, Lipeng, Mehta, Kshitij V., Klasky, Scott A., Wolf, Matthew D., Wang, H Y., Wang, W H., Li, J C., & Lin, Zhihong. Data Management Challenges of Exascale Scientific Simulations: A Case Study with the Gyrokinetic Toroidal Code and ADIOS. United States.
Wan, Lipeng, Mehta, Kshitij V., Klasky, Scott A., Wolf, Matthew D., Wang, H Y., Wang, W H., Li, J C., and Lin, Zhihong. Mon . "Data Management Challenges of Exascale Scientific Simulations: A Case Study with the Gyrokinetic Toroidal Code and ADIOS". United States. https://www.osti.gov/servlets/purl/1558473.
@article{osti_1558473,
title = {Data Management Challenges of Exascale Scientific Simulations: A Case Study with the Gyrokinetic Toroidal Code and ADIOS},
author = {Wan, Lipeng and Mehta, Kshitij V. and Klasky, Scott A. and Wolf, Matthew D. and Wang, H Y. and Wang, W H. and Li, J C. and Lin, Zhihong},
abstractNote = {The push towards exascale computing and the recent introduction of multi-petascale supercomputers have enabled science applications to run complex simulations. However, the gap between compute and I/O has grown wider, even as applications seek to generate and persist increasing amounts of data. Optimizing I/O is challenging and remains a bottleneck at scale. In this paper, we present initial I/O performance results of running Gyrokinetic Toroidal Code (GTC) on Summit, a 200 Petaflop system at Oak Ridge National Laboratory. To manage the complex data in GTC, we use ADIOS, an I/O and data management middleware that provides a rich set of APIs to manage and interact with scientific data. We discuss optimizations performed to obtain improvements in I/O performance and identify a set of challenges that will drive the design and development of next generation data management libraries.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2019},
month = {7}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: