An automatic performance model-based scheduling tool for coupled climate system models

Ding, Nan; Xue, Wei; Song, Zhenya; Fu, Haohuan; Xu, Shiming; Zheng, Weimin

doi:10.1016/j.jpdc.2018.01.002

Title: An automatic performance model-based scheduling tool for coupled climate system models

Abstract

The prediction of the climate system is highly depended on the efficient integration of observations and simulations of the Earth. This is regarded as a canonical example of the cyber-physical system. The climate system model, the simulation engine in this cyber-physical system, is one of most challenging applications in scientific computing. It utilizes the multi-physics simulation that couples multiple components, conducts decadal to millennium simulations, and has long been an important application on supercomputers. However, current climate system models suffer from the inefficient task scheduling methods resulting in an intolerable simulation time. Take the Community Earth System Model (CESM), the most widely used climate system model, as an example, one major reason that CESM suffers from bad performances is the huge overhead to rationally distribute processes among the coupled heterogeneous components. According to the report of NCAR, every percent improvement in CESM performance frees up to the equivalent of $250,000 in computing resources in their scientific experiments. To address such challenge, our paper firstly constructs a lightweight and accurate performance model for effectively capturing and predicting the heterogeneous time-to-solution performance of end-to-end CESM components with a given simulation configuration. Then, based on the performance model, we further propose an efficientmore »« less

Authors:

Ding, Nan ^[1]; Xue, Wei ^[2]; Song, Zhenya ^[3]; Fu, Haohuan ^[4]; Xu, Shiming ^[5]; Zheng, Weimin ^[6]

Tsinghua Univ., Beijing (China). Dept. of Computer Science and Technology; Qingdao National Lab. for Marine Science and Technology (United States). Lab. for Regional Oceanography and Numerical Modeling; Tsinghua Univ., Beijing (China). Ministry of Education Key Lab. for Earth System Modeling
Tsinghua Univ., Beijing (China). Dept. of Computer Science and Technology; Qingdao National Lab. for Marine Science and Technology (United States). Lab. for Regional Oceanography and Numerical Modeling; Tsinghua Univ., Beijing (China). Ministry of Education Key Lab. for Earth System Modeling; National Supercomputing Center, Wuxi (China); Joint Center for Global Change Studies, Beijing (China)
Qingdao National Lab. for Marine Science and Technology (United States). Lab. for Regional Oceanography and Numerical Modeling; ; State Oceanic Administration, Qingdao (China). First Inst. of Oceanography
Qingdao National Lab. for Marine Science and Technology (United States). Lab. for Regional Oceanography and Numerical Modeling; Tsinghua Univ., Beijing (China). Ministry of Education Key Lab. for Earth System Modeling; National Supercomputing Center, Wuxi (China); Joint Center for Global Change Studies, Beijing (China)
Tsinghua Univ., Beijing (China). Ministry of Education Key Lab. for Earth System Modeling
Tsinghua Univ., Beijing (China). Dept. of Computer Science and Technology

Publication Date:: 2018-01-31

Research Org.:: Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)

Sponsoring Org.:: USDOE Office of Science (SC)

OSTI Identifier:: 1559255

Grant/Contract Number:: AC02-05CH11231

Resource Type:: Accepted Manuscript

Journal Name:: Journal of Parallel and Distributed Computing

Additional Journal Information:: Journal Volume: 132; Journal Issue: C; Journal ID: ISSN 0743-7315

Publisher:: Elsevier

Country of Publication:: United States

Language:: English

Subject:: 58 GEOSCIENCES; 97 MATHEMATICS AND COMPUTING

Citation Formats


                    Ding, Nan, Xue, Wei, Song, Zhenya, Fu, Haohuan, Xu, Shiming, and Zheng, Weimin. An automatic performance model-based scheduling tool for coupled climate system models.  United States: N. p., 2018. 
Web.  doi:10.1016/j.jpdc.2018.01.002.

Copy to clipboard


                    Ding, Nan, Xue, Wei, Song, Zhenya, Fu, Haohuan, Xu, Shiming, & Zheng, Weimin. An automatic performance model-based scheduling tool for coupled climate system models.  United States.  https://doi.org/10.1016/j.jpdc.2018.01.002

Copy to clipboard


                    Ding, Nan, Xue, Wei, Song, Zhenya, Fu, Haohuan, Xu, Shiming, and Zheng, Weimin. Wed .  
"An automatic performance model-based scheduling tool for coupled climate system models".  United States.  https://doi.org/10.1016/j.jpdc.2018.01.002.  https://www.osti.gov/servlets/purl/1559255.

Copy to clipboard


                    
@article{osti_1559255,

  title        = {An automatic performance model-based scheduling tool for coupled climate system models},

  author       = {Ding, Nan and Xue, Wei and Song, Zhenya and Fu, Haohuan and Xu, Shiming and Zheng, Weimin},

  abstractNote = {The prediction of the climate system is highly depended on the efficient integration of observations and simulations of the Earth. This is regarded as a canonical example of the cyber-physical system. The climate system model, the simulation engine in this cyber-physical system, is one of most challenging applications in scientific computing. It utilizes the multi-physics simulation that couples multiple components, conducts decadal to millennium simulations, and has long been an important application on supercomputers. However, current climate system models suffer from the inefficient task scheduling methods resulting in an intolerable simulation time. Take the Community Earth System Model (CESM), the most widely used climate system model, as an example, one major reason that CESM suffers from bad performances is the huge overhead to rationally distribute processes among the coupled heterogeneous components. According to the report of NCAR, every percent improvement in CESM performance frees up to the equivalent of $250,000 in computing resources in their scientific experiments. To address such challenge, our paper firstly constructs a lightweight and accurate performance model for effectively capturing and predicting the heterogeneous time-to-solution performance of end-to-end CESM components with a given simulation configuration. Then, based on the performance model, we further propose an efficient scheduling strategy based on rectangular packing method to determine the best process layout among different components, and the process numbers assigned to each component. Our evaluations show that we can achieve 58% average run time reductions on CESM comparing to the widely used sequential process layout for a scale of 144 to 480 cores on typical CPU clusters. And we can save 4 million CPU hours when we conduct one standard scientific experiment (a 2870-year simulation), which equals to save $40,089 with a charge of $0.01 per CPU hour. Meanwhile, 26% extra performance improvements could also be gained in our methods comparing to the heuristic branch and bound algorithm with the guidance of the known curve-fitting performance model.},

  doi          = {10.1016/j.jpdc.2018.01.002},

  journal      = {Journal of Parallel and Distributed Computing},

  number       = C,

  volume       = 132,

  place        = {United States},

  year         = {2018},

  month        = {1}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (DOE)

Publisher's Version of Record

https://doi.org/10.1016/j.jpdc.2018.01.002

Other availability

Search WorldCat to find libraries that may hold this journal

Citation Metrics:

Cited by: 1 work

Citation information provided by
Web of Science

Figures / Tables:

Figure 1: An example of inter-communications among components. The arrows indicate the inter-communication pattern in CESM. For example, the ATM and OCN exchange interfacial flux and state data via CPL; the CPL has grid information for both ATM and OCN and carries out intergrid interpolation of state and flux data,more »

All figures and tables (18 total)

Save / Share:

Export Metadata

Save to My Library

Figures / Tables found in this record:

Figures/Tables have been extracted from DOE-funded journal article accepted manuscripts.

Similar Records in DOE PAGES and OSTI.GOV collections:

Final Report on Data Locality Enhancement of Dynamic Simulations for Exascale Computing

Technical Report Shen, Xipeng

The development of modern processors exhibits two trends that complicate the optimizations of modern software. The first is the increasing sensitivity of processors' throughput to irregularities in computation. With more processors produced through a massive integration of simple cores, future systems will increasingly favor regular data-level parallel computations, but deviate from the needs of applications with complex patterns. Some evidences are already shown on Graphic Processing Units (GPU): Irregular data accesses (e.g., indirect references A[D[i]]) and conditional branches are limiting many GPU applications' performance at a level an order of magnitude lower than the peak of GPU. The second hardwaremore »« less
https://doi.org/10.2172/1576175

Full Text Available
Project Report on DOE Young Investigator Grant (Contract No. DE-FG02-02ER25525) Dynamic Scheduling and Fusion of Irregular Computation (August 15, 2002 to August 14, 2005)

Other Ding, Chen

Computer simulation has become increasingly important in many scientiï¬ c disciplines, but its performance and scalability are severely limited by the memory throughput on today's computer systems. With the support of this grant, we ï¬ rst designed training-based prediction, which accurately predicts the memory performance of large applications before their execution. Then we developed optimization techniques using dynamic computation fusion and large-scale data transformation. The research work has three major components. The ï¬ rst is modeling and prediction of cache behav- ior. We have developed a new technique, which uses reuse distance information from training inputs then extracts a parameterizedmore »« less
Full Text Available
Final Report: Radionuclide Waste Disposal: Development of Multi-scale Experimental and Modeling Capabilities

Technical Report Powell, Brian ; Brinkman, Kyle ; Danjaji, Musa ; ...

The DOE EPSCoR Implementation project “Radioactive waste management: Development of multi-scale experimental and modeling capabilities” helped to develop a team of scientists and engineers from Clemson University, South Carolina State University, and the University of South Carolina to address the disposition of nuclear wastes and study the transport of radioisotopes from a waste repository in the near and far field. The project involved 20 faculty from the three institutions as well as 13 postdoctoral fellows, 32 graduate students, and 32 undergraduate students and was active from 2014-2019. Additionally, we forged new collaborations with nine researchers from DOE laboratories SRNL, LLNL,more »« less
https://doi.org/10.2172/1923972

Full Text Available
Towards a Scalable and Adaptive Application Support Platform for Large-Scale Distributed E-Sciences in High-Performance Network Environments

Technical Report Wu, Chase Qishi ; Zhu, Michelle Mengxia

The advent of large-scale collaborative scientific applications has demonstrated the potential for broad scientific communities to pool globally distributed resources to produce unprecedented data acquisition, movement, and analysis. System resources including supercomputers, data repositories, computing facilities, network infrastructures, storage systems, and display devices have been increasingly deployed at national laboratories and academic institutes. These resources are typically shared by large communities of users over Internet or dedicated networks and hence exhibit an inherent dynamic nature in their availability, accessibility, capacity, and stability. Scientific applications using either experimental facilities or computation-based simulations with various physical, chemical, climatic, and biological models featuremore »« less
https://doi.org/10.2172/1255487

Full Text Available
The Connected Isotopic Water Cycle in the Community Earth System Model Version 1

Journal Article Brady, E. ; Stevenson, S. ; Bailey, D. ; ... - Journal of Advances in Modeling Earth Systems

Because of the pervasive role of water in the Earth system, the relative abundances of stable isotopologues of water are valuable for understanding atmospheric, oceanic, and biospheric processes, and for interpreting paleoclimate proxy reconstructions. Isotopologues are transported by both large-scale and turbulent flows, and the ratio of heavy to light isotopologues changes due to fractionation that can accompany condensation and evaporation processes. Correctly predicting the isotopic distributions requires resolving the relationships between large-scale ocean and atmospheric circulation and smaller-scale hydrological processes, which can be accomplished within a coupled climate modeling framework. Here we present the water isotope-enabled version of the Community Earth System Model version 1 (iCESM1), which simulates global variations in water isotopic ratios in the atmosphere, land, ocean, and sea ice. In a transient Last Millennium simulation covering the 850–2005 period, iCESM1 correctly captures the late-twentieth-century structure ofmore »« less
Cited by 11
https://doi.org/10.1029/2019MS001663

Similar Records