skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0)

Abstract

The Community Earth System Model Ensemble Consistency Test (CESM-ECT) suitewas developed as an alternative to requiring bit wise identical output for quality assurance. This objective test provides a statistical measurement of consistency between an accepted ensemble created by small initial temperature perturbations and a test set of CESM simulations. Here, we extend the CESM-ECT suite with an inexpensive and robust test for ensemble consistency that is applied to Community Atmospheric Model (CAM) output after only nine model time steps. We suggest that adequate ensemble variability is achieved with instantaneous variable values at the ninth step, despite rapid perturbation growth and heterogeneous variable spread. We refer to this new test as the Ultra-Fast CAM Ensemble Consistency Test (UF-CAM-ECT) and demonstrate its effectiveness in practice, including its ability to detect small-scale events and its applicability to the Community Land Model (CLM).The new ultra-fast test facilitates CESM development, porting, and optimization efforts, particularly when used to complement information fromthe original CESM-ECT suite of tools.

Authors:
ORCiD logo [1];  [2]; ORCiD logo [2]; ORCiD logo [1]
+ Show Author Affiliations
  1. Univ. of Colorado, Boulder, CO (United States)
  2. National Center for Atmospheric Research, Boulder, CO (United States)
Publication Date:
Research Org.:
Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
1524175
Grant/Contract Number:  
AC02-05CH11231
Resource Type:
Accepted Manuscript
Journal Name:
Geoscientific Model Development (Online)
Additional Journal Information:
Journal Name: Geoscientific Model Development (Online); Journal Volume: 11; Journal Issue: 2; Journal ID: ISSN 1991-9603
Publisher:
European Geosciences Union
Country of Publication:
United States
Language:
English
Subject:
58 GEOSCIENCES

Citation Formats

Milroy, Daniel J., Baker, Allison H., Hammerling, Dorit M., and Jessup, Elizabeth R. Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0). United States: N. p., 2018. Web. doi:10.5194/gmd-11-697-2018.
Copy to clipboard
Milroy, Daniel J., Baker, Allison H., Hammerling, Dorit M., & Jessup, Elizabeth R. Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0). United States. doi:10.5194/gmd-11-697-2018.
Copy to clipboard
Milroy, Daniel J., Baker, Allison H., Hammerling, Dorit M., and Jessup, Elizabeth R. Mon . "Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0)". United States. doi:10.5194/gmd-11-697-2018. https://www.osti.gov/servlets/purl/1524175.
Copy to clipboard
@article{osti_1524175,
title = {Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0)},
author = {Milroy, Daniel J. and Baker, Allison H. and Hammerling, Dorit M. and Jessup, Elizabeth R.},
abstractNote = {The Community Earth System Model Ensemble Consistency Test (CESM-ECT) suitewas developed as an alternative to requiring bit wise identical output for quality assurance. This objective test provides a statistical measurement of consistency between an accepted ensemble created by small initial temperature perturbations and a test set of CESM simulations. Here, we extend the CESM-ECT suite with an inexpensive and robust test for ensemble consistency that is applied to Community Atmospheric Model (CAM) output after only nine model time steps. We suggest that adequate ensemble variability is achieved with instantaneous variable values at the ninth step, despite rapid perturbation growth and heterogeneous variable spread. We refer to this new test as the Ultra-Fast CAM Ensemble Consistency Test (UF-CAM-ECT) and demonstrate its effectiveness in practice, including its ability to detect small-scale events and its applicability to the Community Land Model (CLM).The new ultra-fast test facilitates CESM development, porting, and optimization efforts, particularly when used to complement information fromthe original CESM-ECT suite of tools.},
doi = {10.5194/gmd-11-697-2018},
journal = {Geoscientific Model Development (Online)},
number = 2,
volume = 11,
place = {United States},
year = {2018},
month = {2}
}
Copy to clipboard
Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
DOI:  10.5194/gmd-11-697-2018
Copyright Statement
Other availability
Search WorldCat Search WorldCat to find libraries that may hold this journal

Figures / Tables:

Figure 1 Figure 1: Representation of effects of initial CAM temperature perturbation over 11 time steps (including t = 0). CAM variables are listed on the vertical axis, and the horizontal axis records the simulation time step. The color bar designates equality of the corresponding variables between the unperturbed and perturbed simulations’more » area weighted global means after being rounded to n significant digits (n is the color) at each time step. Time steps where the corresponding variable was not computed (subcycled variables) are colored black. White indicates equality of greater than nine significant digits (i.e., 10–17). Red variable names are not used by UF-CAM-ECT.« less
All figures and tables (7 total)
Save / Share:
Export Metadata
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.

Works referenced in this record:

A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0)
journal, January 2015

  • Baker, A. H.; Hammerling, D. M.; Levy, M. N.
  • Geoscientific Model Development, Vol. 8, Issue 9
  • DOI: 10.5194/gmd-8-2829-2015

Two Limits of Initial-Value Decadal Predictability in a CGCM
journal, December 2010

The Community Earth System Model (CESM) Large Ensemble Project: A Community Resource for Studying Climate Change in the Presence of Internal Climate Variability
journal, August 2015

  • Kay, J. E.; Deser, C.; Phillips, A.
  • Bulletin of the American Meteorological Society, Vol. 96, Issue 8
  • DOI: 10.1175/BAMS-D-13-00255.1

Evaluating statistical consistency in the ocean model component of the Community Earth System Model (pyCECT v2.0)
journal, January 2016

  • Baker, Allison H.; Hu, Yong; Hammerling, Dorit M.
  • Geoscientific Model Development, Vol. 9, Issue 7
  • DOI: 10.5194/gmd-9-2391-2016

The Community Earth System Model: A Framework for Collaborative Research
journal, September 2013

  • Hurrell, James W.; Holland, M. M.; Gent, P. R.
  • Bulletin of the American Meteorological Society, Vol. 94, Issue 9
  • DOI: 10.1175/BAMS-D-12-00121.1

Deploying RMACC Summit: An HPC Resource for the Rocky Mountain Region
conference, January 2017

  • Anderson, Jonathon; Burns, Patrick J.; Milroy, Daniel
  • Proceedings of the Practice and Experience in Advanced Research Computing 2017 on Sustainability, Success and Impact - PEARC17
  • DOI: 10.1145/3093338.3093379

A new and inexpensive non-bit-for-bit solution reproducibility test based on time step convergence (TSC1.0)
journal, January 2017

  • Wan, Hui; Zhang, Kai; Rasch, Philip J.
  • Geoscientific Model Development, Vol. 10, Issue 2
  • DOI: 10.5194/gmd-10-537-2017

Uncertainty in climate change projections: the role of internal variability
journal, December 2010

The Accumulation of Rounding Errors and Port Validation for Global Atmospheric Models
journal, March 1997

  • Rosinski, James M.; Williamson, David L.
  • SIAM Journal on Scientific Computing, Vol. 18, Issue 2
  • DOI: 10.1137/S1064827594275534

Towards Characterizing the Variability of Statistically Consistent Community Earth System Model Simulations
journal, January 2016

    [ × clear filter / sort ]

    Figures / Tables found in this record:

    Figure 1(p. 4)figure
    Figure 2(p. 5)figure
    Figure 3(p. 7)figure
    Table 1(p. 7)table
    Table 2(p. 9)table
    Table 3(p. 9)table
    Figure 4(p. 11)figure
      [ × clear filter / sort ]
      Figures/Tables have been extracted from DOE-funded journal article accepted manuscripts.

      Similar records in OSTI.GOV collections: