DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale

Abstract

A strict throughput requirement has placed a cap on the degree to which we can depend on the execution of single, long, fine spatial grid simulations to explore global atmospheric climate behavior. Alternatively, running an ensemble of short simulations is computationally more efficient. We test the null hypothesis that the climate statistics of a full-complexity atmospheric model derived from an ensemble of independent short simulation is equivalent to that from an equilibrated long simulation. The climate of short simulation ensembles is statistically distinguishable from that of a long simulation in terms of the distribution of global annual means, largely due to the presence of low-frequency atmospheric intrinsic variability in the long simulation. We also find that model climate statistics of the simulation ensemble are sensitive to the choice of compiler optimizations. While some answer-changing optimization choices do not effect the climate state in terms of mean, variability and extremes, aggressive optimizations can result in significantly different climate states.

Authors:
 [1];  [1];  [1];  [2]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Computational Earth Sciences and Climate Change Science Inst.
  2. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility and Climate Change Science Inst.
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
1567444
Grant/Contract Number:  
AC05-00OR22725
Resource Type:
Accepted Manuscript
Journal Name:
Procedia Computer Science
Additional Journal Information:
Journal Volume: 108; Journal Issue: C; Journal ID: ISSN 1877-0509
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES; Computer Science; reproducibility; climate simulation; ensemble testing

Citation Formats

Mahajan, Salil, Gaddis, Abigail L., Evans, Katherine J., and Norman, Matthew R. Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale. United States: N. p., 2017. Web. doi:10.1016/j.procs.2017.05.259.
Mahajan, Salil, Gaddis, Abigail L., Evans, Katherine J., & Norman, Matthew R. Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale. United States. https://doi.org/10.1016/j.procs.2017.05.259
Mahajan, Salil, Gaddis, Abigail L., Evans, Katherine J., and Norman, Matthew R. Fri . "Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale". United States. https://doi.org/10.1016/j.procs.2017.05.259. https://www.osti.gov/servlets/purl/1567444.
@article{osti_1567444,
title = {Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale},
author = {Mahajan, Salil and Gaddis, Abigail L. and Evans, Katherine J. and Norman, Matthew R.},
abstractNote = {A strict throughput requirement has placed a cap on the degree to which we can depend on the execution of single, long, fine spatial grid simulations to explore global atmospheric climate behavior. Alternatively, running an ensemble of short simulations is computationally more efficient. We test the null hypothesis that the climate statistics of a full-complexity atmospheric model derived from an ensemble of independent short simulation is equivalent to that from an equilibrated long simulation. The climate of short simulation ensembles is statistically distinguishable from that of a long simulation in terms of the distribution of global annual means, largely due to the presence of low-frequency atmospheric intrinsic variability in the long simulation. We also find that model climate statistics of the simulation ensemble are sensitive to the choice of compiler optimizations. While some answer-changing optimization choices do not effect the climate state in terms of mean, variability and extremes, aggressive optimizations can result in significantly different climate states.},
doi = {10.1016/j.procs.2017.05.259},
journal = {Procedia Computer Science},
number = C,
volume = 108,
place = {United States},
year = {Fri Jun 09 00:00:00 EDT 2017},
month = {Fri Jun 09 00:00:00 EDT 2017}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 7 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0)
journal, January 2015

  • Baker, A. H.; Hammerling, D. M.; Levy, M. N.
  • Geoscientific Model Development, Vol. 8, Issue 9
  • DOI: 10.5194/gmd-8-2829-2015

On the use of programmable hardware and reduced numerical precision in earth-system modeling: REDUCED PRECISION IN GEOSCIENCE
journal, September 2015

  • Düben, Peter D.; Russell, Francis P.; Niu, Xinyu
  • Journal of Advances in Modeling Earth Systems, Vol. 7, Issue 3
  • DOI: 10.1002/2015MS000494

The Community Earth System Model (CESM) Large Ensemble Project: A Community Resource for Studying Climate Change in the Presence of Internal Climate Variability
journal, August 2015

  • Kay, J. E.; Deser, C.; Phillips, A.
  • Bulletin of the American Meteorological Society, Vol. 96, Issue 8
  • DOI: 10.1175/BAMS-D-13-00255.1

A spectral transform dynamical core option within the Community Atmosphere Model (CAM4)
journal, September 2014

  • Evans, Katherine J.; Mahajan, Salil; Branstetter, Marcia
  • Journal of Advances in Modeling Earth Systems, Vol. 6, Issue 3
  • DOI: 10.1002/2014MS000329

On the Zonal Structure of the North Atlantic Oscillation and Annular Modes
journal, February 2009

  • Gerber, Edwin P.; Vallis, Geoffrey K.
  • Journal of the Atmospheric Sciences, Vol. 66, Issue 2
  • DOI: 10.1175/2008JAS2682.1

Ultra-low-frequency variability in a simple atmospheric circulation model
journal, November 1989


Fidelity of Precipitation Extremes in High Resolution Global Climate Simulations
journal, January 2015


Towards Characterizing the Variability of Statistically Consistent Community Earth System Model Simulations
journal, January 2016


Short ensembles: an efficient method for discerning climate-relevant sensitivities in atmospheric general circulation models
journal, January 2014


A new and inexpensive non-bit-for-bit solution reproducibility test based on time step convergence (TSC1.0)
journal, January 2017

  • Wan, Hui; Zhang, Kai; Rasch, Philip J.
  • Geoscientific Model Development, Vol. 10, Issue 2
  • DOI: 10.5194/gmd-10-537-2017

Works referencing / citing this record:

A Multivariate Approach to Ensure Statistical Reproducibility of Climate Model Simulations
conference, June 2019

  • Mahajan, Salil; Evans, Katherine J.; Kennedy, Joseph H.
  • PASC '19: Platform for Advanced Scientific Computing Conference, Proceedings of the Platform for Advanced Scientific Computing Conference
  • DOI: 10.1145/3324989.3325724

LIVVkit 2.1: automated and extensible ice sheet model validation
journal, January 2019

  • Evans, Katherine J.; Kennedy, Joseph H.; Lu, Dan
  • Geoscientific Model Development, Vol. 12, Issue 3
  • DOI: 10.5194/gmd-12-1067-2019