Parallel Computing for Module-Based Computational Experiment
Abstract
Large-scale scientific code plays an important role in scientific researches. In order to facilitate module and element evaluation in scientific applications, we introduce a unit testing framework and describe the demand for module-based experiment customization. We then develop a parallel version of the unit testing framework to handle long-term simulations with a large amount of data. Specifically, we apply message passing based parallelization and I/O behavior optimization to improve the performance of the unit testing framework and use profiling result to guide the parallel process implementation. Finally, we present a case study on litter decomposition experiment using a standalone module from a large-scale Earth System Model. This case study is also a good demonstration on the scalability, portability, and high-efficiency of the framework.
- Authors:
-
- University of Tennessee, Knoxville (UTK)
- ORNL
- Jilin University, China
- Publication Date:
- Research Org.:
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Sponsoring Org.:
- USDOE Office of Science (SC), Biological and Environmental Research (BER)
- OSTI Identifier:
- 1542200
- DOE Contract Number:
- AC05-00OR22725
- Resource Type:
- Conference
- Resource Relation:
- Journal Volume: 11537; Conference: International Conference on Computational Sciences - Faro, , Portugal - 6/12/2019 4:00:00 AM-6/14/2019 4:00:00 AM
- Country of Publication:
- United States
- Language:
- English
Citation Formats
Yao, Zhuo, Wang, Dali, Ricciuto, Daniel M., Yuan, Fengming, and Fang, Chunsheng. Parallel Computing for Module-Based Computational Experiment. United States: N. p., 2019.
Web. doi:10.1007/978-3-030-22741-8_27.
Yao, Zhuo, Wang, Dali, Ricciuto, Daniel M., Yuan, Fengming, & Fang, Chunsheng. Parallel Computing for Module-Based Computational Experiment. United States. https://doi.org/10.1007/978-3-030-22741-8_27
Yao, Zhuo, Wang, Dali, Ricciuto, Daniel M., Yuan, Fengming, and Fang, Chunsheng. 2019.
"Parallel Computing for Module-Based Computational Experiment". United States. https://doi.org/10.1007/978-3-030-22741-8_27. https://www.osti.gov/servlets/purl/1542200.
@article{osti_1542200,
title = {Parallel Computing for Module-Based Computational Experiment},
author = {Yao, Zhuo and Wang, Dali and Ricciuto, Daniel M. and Yuan, Fengming and Fang, Chunsheng},
abstractNote = {Large-scale scientific code plays an important role in scientific researches. In order to facilitate module and element evaluation in scientific applications, we introduce a unit testing framework and describe the demand for module-based experiment customization. We then develop a parallel version of the unit testing framework to handle long-term simulations with a large amount of data. Specifically, we apply message passing based parallelization and I/O behavior optimization to improve the performance of the unit testing framework and use profiling result to guide the parallel process implementation. Finally, we present a case study on litter decomposition experiment using a standalone module from a large-scale Earth System Model. This case study is also a good demonstration on the scalability, portability, and high-efficiency of the framework.},
doi = {10.1007/978-3-030-22741-8_27},
url = {https://www.osti.gov/biblio/1542200},
journal = {},
issn = {0302-9743},
number = ,
volume = 11537,
place = {United States},
year = {Sat Jun 01 00:00:00 EDT 2019},
month = {Sat Jun 01 00:00:00 EDT 2019}
}
Works referenced in this record:
Evaluating litter decomposition in earth system models with long-term litterbag experiments: an example using the Community Land Model version 4 (CLM4)
journal, October 2012
- Bonan, Gordon B.; Hartman, Melannie D.; Parton, William J.
- Global Change Biology, Vol. 19, Issue 3
KGEN: A Python Tool for Automated Fortran Kernel Generation and Verification
journal, January 2016
- Kim, Youngsung; Dennis, John; Kerr, Christopher
- Procedia Computer Science, Vol. 80
The ideal HPC programming language
journal, July 2010
- Loh, Eugene
- Communications of the ACM, Vol. 53, Issue 7
Technical Description of version 4.0 of the Community Land Model (CLM)
text, January 2010
- Oleson, Keith; Lawrence, David; Bonan, Gordon
- UCAR/NCAR
Ecosystem model spin-up: Estimating steady state conditions in a coupled terrestrial carbon and nitrogen cycle model
journal, November 2005
- Thornton, Peter E.; Rosenbloom, Nan A.
- Ecological Modelling, Vol. 189, Issue 1-2
A Scientific Function Test Framework for Modular Environmental Model Development: Application to the Community Land Model
conference, May 2015
- Wang, Dali; Janjusic, Tomislav; Iversen, Colleen
- 2015 IEEE/ACM 1st International Workshop on Software Engineering for High Performance Computing in Science (SE4HPCS)
Climate Change Modeling: Computational Opportunities and Challenges
journal, September 2011
- Wang, Dali; Post, Wilfred; Wilson, Bruce
- Computing in Science & Engineering, Vol. 13, Issue 5
Toward Better Understanding of the Community Land Model within the Earth System Modeling Framework
journal, January 2014
- Wang, Dali; Schuchart, Joseph; Janjusic, Tomislav
- Procedia Computer Science, Vol. 29
Virtual Observation System for Earth System Model: An Application to ACME Land Model Simulations
journal, January 2017
- Wang, Dali; Yuan, Fengming; Hernandez, Benjamin
- International Journal of Advanced Computer Science and Applications, Vol. 8, Issue 2
In Situ Data Infrastructure for Scientific Unit Testing Platform 1
journal, January 2016
- Yao, Zhuo; Jia, Yulu; Wang, Dali
- Procedia Computer Science, Vol. 80