Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0)
Abstract
The Community Earth System Model Ensemble Consistency Test (CESM-ECT) suitewas developed as an alternative to requiring bit wise identical output for quality assurance. This objective test provides a statistical measurement of consistency between an accepted ensemble created by small initial temperature perturbations and a test set of CESM simulations. Here, we extend the CESM-ECT suite with an inexpensive and robust test for ensemble consistency that is applied to Community Atmospheric Model (CAM) output after only nine model time steps. We suggest that adequate ensemble variability is achieved with instantaneous variable values at the ninth step, despite rapid perturbation growth and heterogeneous variable spread. We refer to this new test as the Ultra-Fast CAM Ensemble Consistency Test (UF-CAM-ECT) and demonstrate its effectiveness in practice, including its ability to detect small-scale events and its applicability to the Community Land Model (CLM).The new ultra-fast test facilitates CESM development, porting, and optimization efforts, particularly when used to complement information fromthe original CESM-ECT suite of tools.
- Authors:
-
- Univ. of Colorado, Boulder, CO (United States)
- National Center for Atmospheric Research, Boulder, CO (United States)
- Publication Date:
- Research Org.:
- Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC)
- OSTI Identifier:
- 1524175
- Grant/Contract Number:
- AC02-05CH11231
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Geoscientific Model Development (Online)
- Additional Journal Information:
- Journal Name: Geoscientific Model Development (Online); Journal Volume: 11; Journal Issue: 2; Journal ID: ISSN 1991-9603
- Publisher:
- European Geosciences Union
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 58 GEOSCIENCES
Citation Formats
Milroy, Daniel J., Baker, Allison H., Hammerling, Dorit M., and Jessup, Elizabeth R. Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0). United States: N. p., 2018.
Web. doi:10.5194/gmd-11-697-2018.
Milroy, Daniel J., Baker, Allison H., Hammerling, Dorit M., & Jessup, Elizabeth R. Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0). United States. doi:10.5194/gmd-11-697-2018.
Milroy, Daniel J., Baker, Allison H., Hammerling, Dorit M., and Jessup, Elizabeth R. Mon .
"Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0)". United States. doi:10.5194/gmd-11-697-2018. https://www.osti.gov/servlets/purl/1524175.
@article{osti_1524175,
title = {Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0)},
author = {Milroy, Daniel J. and Baker, Allison H. and Hammerling, Dorit M. and Jessup, Elizabeth R.},
abstractNote = {The Community Earth System Model Ensemble Consistency Test (CESM-ECT) suitewas developed as an alternative to requiring bit wise identical output for quality assurance. This objective test provides a statistical measurement of consistency between an accepted ensemble created by small initial temperature perturbations and a test set of CESM simulations. Here, we extend the CESM-ECT suite with an inexpensive and robust test for ensemble consistency that is applied to Community Atmospheric Model (CAM) output after only nine model time steps. We suggest that adequate ensemble variability is achieved with instantaneous variable values at the ninth step, despite rapid perturbation growth and heterogeneous variable spread. We refer to this new test as the Ultra-Fast CAM Ensemble Consistency Test (UF-CAM-ECT) and demonstrate its effectiveness in practice, including its ability to detect small-scale events and its applicability to the Community Land Model (CLM).The new ultra-fast test facilitates CESM development, porting, and optimization efforts, particularly when used to complement information fromthe original CESM-ECT suite of tools.},
doi = {10.5194/gmd-11-697-2018},
journal = {Geoscientific Model Development (Online)},
number = 2,
volume = 11,
place = {United States},
year = {2018},
month = {2}
}
Web of Science
Figures / Tables:

Works referenced in this record:
A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0)
journal, January 2015
- Baker, A. H.; Hammerling, D. M.; Levy, M. N.
- Geoscientific Model Development, Vol. 8, Issue 9
Two Limits of Initial-Value Decadal Predictability in a CGCM
journal, December 2010
- Branstator, Grant; Teng, Haiyan
- Journal of Climate, Vol. 23, Issue 23
The Community Earth System Model (CESM) Large Ensemble Project: A Community Resource for Studying Climate Change in the Presence of Internal Climate Variability
journal, August 2015
- Kay, J. E.; Deser, C.; Phillips, A.
- Bulletin of the American Meteorological Society, Vol. 96, Issue 8
Evaluating statistical consistency in the ocean model component of the Community Earth System Model (pyCECT v2.0)
journal, January 2016
- Baker, Allison H.; Hu, Yong; Hammerling, Dorit M.
- Geoscientific Model Development, Vol. 9, Issue 7
The Community Earth System Model: A Framework for Collaborative Research
journal, September 2013
- Hurrell, James W.; Holland, M. M.; Gent, P. R.
- Bulletin of the American Meteorological Society, Vol. 94, Issue 9
Deploying RMACC Summit: An HPC Resource for the Rocky Mountain Region
conference, January 2017
- Anderson, Jonathon; Burns, Patrick J.; Milroy, Daniel
- Proceedings of the Practice and Experience in Advanced Research Computing 2017 on Sustainability, Success and Impact - PEARC17
A new and inexpensive non-bit-for-bit solution reproducibility test based on time step convergence (TSC1.0)
journal, January 2017
- Wan, Hui; Zhang, Kai; Rasch, Philip J.
- Geoscientific Model Development, Vol. 10, Issue 2
Uncertainty in climate change projections: the role of internal variability
journal, December 2010
- Deser, Clara; Phillips, Adam; Bourdette, Vincent
- Climate Dynamics, Vol. 38, Issue 3-4
The Accumulation of Rounding Errors and Port Validation for Global Atmospheric Models
journal, March 1997
- Rosinski, James M.; Williamson, David L.
- SIAM Journal on Scientific Computing, Vol. 18, Issue 2
Towards Characterizing the Variability of Statistically Consistent Community Earth System Model Simulations
journal, January 2016
- Milroy, Daniel J.; Baker, Allison H.; Hammerling, Dorit M.
- Procedia Computer Science, Vol. 80
Works referencing / citing this record:
Deploying RMACC Summit: An HPC Resource for the Rocky Mountain Region
conference, January 2017
- Anderson, Jonathon; Burns, Patrick J.; Milroy, Daniel
- Proceedings of the Practice and Experience in Advanced Research Computing 2017 on Sustainability, Success and Impact - PEARC17
Figures / Tables found in this record: