skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A new test statistic for climate models that includes field and spatial dependencies using Gaussian Markov random fields

Abstract

Abstract. A new test statistic for climate model evaluation has been developed that potentially mitigates some of the limitations that exist for observing and representing field and space dependencies of climate phenomena. Traditionally such dependencies have been ignored when climate models have been evaluated against observational data, which makes it difficult to assess whether any given model is simulating observed climate for the right reasons. The new statistic uses Gaussian Markov random fields for estimating field and space dependencies within a first-order grid point neighborhood structure. We illustrate the ability of Gaussian Markov random fields to represent empirical estimates of field and space covariances using "witch hat" graphs. We further use the new statistic to evaluate the tropical response of a climate model (CAM3.1) to changes in two parameters important to its representation of cloud and precipitation physics. Overall, the inclusion of dependency information did not alter significantly the recognition of those regions of parameter space that best approximated observations. However, there were some qualitative differences in the shape of the response surface that suggest how such a measure could affect estimates of model uncertainty.

Authors:
; ;
Publication Date:
Research Org.:
Univ. of Texas, Austin, TX (United States). Inst. for Geophysics
Sponsoring Org.:
Office of Science (SC), Biological and Environmental Research (BER). Earth and Environmental Systems Science Division
OSTI Identifier:
1266397
Alternate Identifier(s):
OSTI ID: 1437161
Grant/Contract Number:  
SC0006985; SC0010843
Resource Type:
Published Article
Journal Name:
Geoscientific Model Development (Online)
Additional Journal Information:
Journal Name: Geoscientific Model Development (Online) Journal Volume: 9 Journal Issue: 7; Journal ID: ISSN 1991-9603
Publisher:
Copernicus Publications, EGU
Country of Publication:
Germany
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES

Citation Formats

Nosedal-Sanchez, Alvaro, Jackson, Charles S., and Huerta, Gabriel. A new test statistic for climate models that includes field and spatial dependencies using Gaussian Markov random fields. Germany: N. p., 2016. Web. https://doi.org/10.5194/gmd-9-2407-2016.
Nosedal-Sanchez, Alvaro, Jackson, Charles S., & Huerta, Gabriel. A new test statistic for climate models that includes field and spatial dependencies using Gaussian Markov random fields. Germany. https://doi.org/10.5194/gmd-9-2407-2016
Nosedal-Sanchez, Alvaro, Jackson, Charles S., and Huerta, Gabriel. Wed . "A new test statistic for climate models that includes field and spatial dependencies using Gaussian Markov random fields". Germany. https://doi.org/10.5194/gmd-9-2407-2016.
@article{osti_1266397,
title = {A new test statistic for climate models that includes field and spatial dependencies using Gaussian Markov random fields},
author = {Nosedal-Sanchez, Alvaro and Jackson, Charles S. and Huerta, Gabriel},
abstractNote = {Abstract. A new test statistic for climate model evaluation has been developed that potentially mitigates some of the limitations that exist for observing and representing field and space dependencies of climate phenomena. Traditionally such dependencies have been ignored when climate models have been evaluated against observational data, which makes it difficult to assess whether any given model is simulating observed climate for the right reasons. The new statistic uses Gaussian Markov random fields for estimating field and space dependencies within a first-order grid point neighborhood structure. We illustrate the ability of Gaussian Markov random fields to represent empirical estimates of field and space covariances using "witch hat" graphs. We further use the new statistic to evaluate the tropical response of a climate model (CAM3.1) to changes in two parameters important to its representation of cloud and precipitation physics. Overall, the inclusion of dependency information did not alter significantly the recognition of those regions of parameter space that best approximated observations. However, there were some qualitative differences in the shape of the response surface that suggest how such a measure could affect estimates of model uncertainty.},
doi = {10.5194/gmd-9-2407-2016},
journal = {Geoscientific Model Development (Online)},
number = 7,
volume = 9,
place = {Germany},
year = {2016},
month = {7}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.5194/gmd-9-2407-2016

Save / Share:

Works referenced in this record:

Incorporating model quality information in climate change detection and attribution studies
journal, August 2009

  • Santer, B. D.; Taylor, K. E.; Gleckler, P. J.
  • Proceedings of the National Academy of Sciences, Vol. 106, Issue 35
  • DOI: 10.1073/pnas.0901736106

Performance metrics for climate models
journal, January 2008

  • Gleckler, P. J.; Taylor, K. E.; Doutriaux, C.
  • Journal of Geophysical Research, Vol. 113, Issue D6
  • DOI: 10.1029/2007JD008972

How Well Do Coupled Models Simulate Today's Climate?
journal, March 2008

  • Reichler, Thomas; Kim, Junsu
  • Bulletin of the American Meteorological Society, Vol. 89, Issue 3
  • DOI: 10.1175/BAMS-89-3-303

A likelihood-based comparison of temporal models for physical processes
journal, April 2011

  • Braverman, Amy; Cressie, Noel; Teixeira, Joao
  • Statistical Analysis and Data Mining, Vol. 4, Issue 3
  • DOI: 10.1002/sam.10113

Risks of Model Weighting in Multimodel Climate Projections
journal, August 2010

  • Weigel, Andreas P.; Knutti, Reto; Liniger, Mark A.
  • Journal of Climate, Vol. 23, Issue 15
  • DOI: 10.1175/2010JCLI3594.1

Progress and Prospects for Reanalysis for Weather and Climate
journal, January 2008

  • Trenberth, Kevin E.; Koike, Toshio; Onogi, Kazutoshi
  • Eos, Transactions American Geophysical Union, Vol. 89, Issue 26
  • DOI: 10.1029/2008EO260002

Challenges in Combining Projections from Multiple Climate Models
journal, May 2010

  • Knutti, Reto; Furrer, Reinhard; Tebaldi, Claudia
  • Journal of Climate, Vol. 23, Issue 10
  • DOI: 10.1175/2009JCLI3361.1

The Formulation and Atmospheric Simulation of the Community Atmosphere Model Version 3 (CAM3)
journal, June 2006

  • Collins, William D.; Rasch, Philip J.; Boville, Byron A.
  • Journal of Climate, Vol. 19, Issue 11
  • DOI: 10.1175/JCLI3760.1

The ERA-40 re-analysis
journal, October 2005

  • Uppala, S. M.; KÅllberg, P. W.; Simmons, A. J.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 131, Issue 612
  • DOI: 10.1256/qj.04.176

Summarizing multiple aspects of model performance in a single diagram
journal, April 2001

  • Taylor, Karl E.
  • Journal of Geophysical Research: Atmospheres, Vol. 106, Issue D7
  • DOI: 10.1029/2000JD900719

    Works referencing / citing this record:

    Characterizing the Relative Importance Assigned to Physical Variables by Climate Scientists when Assessing Atmospheric Climate Model Fidelity
    journal, July 2018

    • Burrows, Susannah M.; Dasgupta, Aritra; Reehl, Sarah
    • Advances in Atmospheric Sciences, Vol. 35, Issue 9
    • DOI: 10.1007/s00376-018-7300-x