skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Moving beyond the total sea ice extent in gauging model biases

Abstract

Here, reproducing characteristics of observed sea ice extent remains an important climate modeling challenge. This study describes several approaches to improve how model biases in total sea ice distribution are quantified, and applies them to historically forced simulations contributed to phase 5 of the Coupled Model Intercomparison Project (CMIP5). The quantity of hemispheric total sea ice area, or some measure of its equatorward extent, is often used to evaluate model performance. A new approach is introduced that investigates additional details about the structure of model errors, with an aim to reduce the potential impact of compensating errors when gauging differences between simulated and observed sea ice. Using multiple observational datasets, several new methods are applied to evaluate the climatological spatial distribution and the annual cycle of sea ice cover in 41 CMIP5 models. It is shown that in some models, error compensation can be substantial, for example resulting from too much sea ice in one region and too little in another. Error compensation tends to be larger in models that agree more closely with the observed total sea ice area, which may result from model tuning. The results herein suggest that consideration of only the total hemispheric sea ice areamore » or extent can be misleading when quantitatively comparing how well models agree with observations. Further work is needed to fully develop robust methods to holistically evaluate the ability of models to capture the finescale structure of sea ice characteristics; however, the “sector scale” metric used here aids in reducing the impact of compensating errors in hemispheric integrals.« less

Authors:
 [1];  [2];  [2];  [2];  [3]
  1. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States); Nansen Environmental and Remote Sensing Center and Bjerknes Centre for Climate Research, Bergen (Norway)
  2. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
  3. Columbia Univ., New York, NY (United States)
Publication Date:
Research Org.:
Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1342069
Report Number(s):
LLNL-JRNL-680923
Journal ID: ISSN 0894-8755
Grant/Contract Number:  
AC52-07NA27344
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Climate
Additional Journal Information:
Journal Volume: 29; Journal Issue: 24; Journal ID: ISSN 0894-8755
Publisher:
American Meteorological Society
Country of Publication:
United States
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES; 58 GEOSCIENCES; climate models; coupled models; general circulation models; model comparison; model errors; model evaluation/performance

Citation Formats

Ivanova, Detelina P., Gleckler, Peter J., Taylor, Karl E., Durack, Paul J., and Marvel, Kate D.. Moving beyond the total sea ice extent in gauging model biases. United States: N. p., 2016. Web. https://doi.org/10.1175/JCLI-D-16-0026.1.
Ivanova, Detelina P., Gleckler, Peter J., Taylor, Karl E., Durack, Paul J., & Marvel, Kate D.. Moving beyond the total sea ice extent in gauging model biases. United States. https://doi.org/10.1175/JCLI-D-16-0026.1
Ivanova, Detelina P., Gleckler, Peter J., Taylor, Karl E., Durack, Paul J., and Marvel, Kate D.. Tue . "Moving beyond the total sea ice extent in gauging model biases". United States. https://doi.org/10.1175/JCLI-D-16-0026.1. https://www.osti.gov/servlets/purl/1342069.
@article{osti_1342069,
title = {Moving beyond the total sea ice extent in gauging model biases},
author = {Ivanova, Detelina P. and Gleckler, Peter J. and Taylor, Karl E. and Durack, Paul J. and Marvel, Kate D.},
abstractNote = {Here, reproducing characteristics of observed sea ice extent remains an important climate modeling challenge. This study describes several approaches to improve how model biases in total sea ice distribution are quantified, and applies them to historically forced simulations contributed to phase 5 of the Coupled Model Intercomparison Project (CMIP5). The quantity of hemispheric total sea ice area, or some measure of its equatorward extent, is often used to evaluate model performance. A new approach is introduced that investigates additional details about the structure of model errors, with an aim to reduce the potential impact of compensating errors when gauging differences between simulated and observed sea ice. Using multiple observational datasets, several new methods are applied to evaluate the climatological spatial distribution and the annual cycle of sea ice cover in 41 CMIP5 models. It is shown that in some models, error compensation can be substantial, for example resulting from too much sea ice in one region and too little in another. Error compensation tends to be larger in models that agree more closely with the observed total sea ice area, which may result from model tuning. The results herein suggest that consideration of only the total hemispheric sea ice area or extent can be misleading when quantitatively comparing how well models agree with observations. Further work is needed to fully develop robust methods to holistically evaluate the ability of models to capture the finescale structure of sea ice characteristics; however, the “sector scale” metric used here aids in reducing the impact of compensating errors in hemispheric integrals.},
doi = {10.1175/JCLI-D-16-0026.1},
journal = {Journal of Climate},
number = 24,
volume = 29,
place = {United States},
year = {2016},
month = {11}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 2 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Intercomparison of passive microwave sea ice concentration retrievals over the high-concentration Arctic sea ice
journal, January 2007

  • Andersen, Søren; Tonboe, Rasmus; Kaleschke, Lars
  • Journal of Geophysical Research, Vol. 112, Issue C8
  • DOI: 10.1029/2006JC003543

The Flexible Global Ocean-Atmosphere-Land system model, Spectral Version 2: FGOALS-s2
journal, April 2013


The Norwegian Earth System Model, NorESM1-M – Part 1: Description and basic evaluation
journal, January 2012

  • Bentsen, M.; Bethke, I.; Debernard, J. B.
  • Geoscientific Model Development Discussions, Vol. 5, Issue 3
  • DOI: 10.5194/gmdd-5-2843-2012

Antarctic sea-ice thickness and volume estimates from ice charts between 1995 and 1998
journal, January 2015

  • Bernstein, E. Rachel; Geiger, Cathleen A.; Deliberty, Tracy L.
  • Annals of Glaciology, Vol. 56, Issue 69
  • DOI: 10.3189/2015AoG69A763

The ACCESS coupled model: description, control climate and evaluation
journal, March 2013

  • Bi, D.; Dix, M.; Marsland, S.
  • Australian Meteorological and Oceanographic Journal, Vol. 63, Issue 1
  • DOI: 10.22499/2.6301.004

ACCESS-OM: the ocean and sea-ice core of the ACCESS coupled model
journal, March 2013

  • Bi, D.; Marsland, S.; Uotila, P.
  • Australian Meteorological and Oceanographic Journal, Vol. 63, Issue 1
  • DOI: 10.22499/2.6301.014

Sea Ice Concentrations from Nimbus-7 SMMR and DMSP SSM/I-SSMIS Passive Microwave Data, Version 1
null, January 1996

  • Cavalieri, Donald
  • NASA National Snow and Ice Data Center Distributed Active Archive Center
  • DOI: 10.5067/8GQ8LZQVL0VL

Passive microwave algorithms for sea ice concentration: A comparison of two techniques
journal, June 1997

  • Comiso, Josefino C.; Cavalieri, Donald J.; Parkinson, Claire L.
  • Remote Sensing of Environment, Vol. 60, Issue 3
  • DOI: 10.1016/S0034-4257(96)00220-9

Climate change projections using the IPSL-CM5 Earth System Model: from CMIP3 to CMIP5
journal, February 2013


GFDL’s ESM2 Global Coupled Climate–Carbon Earth System Models. Part I: Physical Formulation and Baseline Simulation Characteristics
journal, October 2012


Sea Ice Index, Version 2
dataset, January 2016

  • M., Fetterer, F. ; Knowles, K. ; Meier, W. ; Savoie,
  • NSIDC
  • DOI: 10.7265/N5736NV7

The Community Climate System Model Version 4
journal, October 2011

  • Gent, Peter R.; Danabasoglu, Gokhan; Donner, Leo J.
  • Journal of Climate, Vol. 24, Issue 19
  • DOI: 10.1175/2011JCLI4083.1

The simulation of SST, sea ice extents and ocean heat transports in a version of the Hadley Centre coupled model without flux adjustments
journal, February 2000


The GFDL CM3 Coupled Climate Model: Characteristics of the Ocean and Sea Ice Simulations
journal, July 2011

  • Griffies, Stephen M.; Winton, Michael; Donner, Leo J.
  • Journal of Climate, Vol. 24, Issue 13
  • DOI: 10.1175/2011JCLI3964.1

EC-Earth V2.2: description and validation of a new seamless earth system prediction model
journal, December 2011


The Norwegian Earth System Model, NorESM1-M – Part 2: Climate response and scenario projections
journal, January 2012

  • Iversen, T.; Bentsen, M.; Bethke, I.
  • Geoscientific Model Development Discussions, Vol. 5, Issue 3
  • DOI: 10.5194/gmdd-5-2933-2012

Australia's CMIP5 submission using the CSIRO-Mk3.6 model
journal, March 2013

  • Jeffrey, S.; Rotstayn, L.; Collier, M.
  • Australian Meteorological and Oceanographic Journal, Vol. 63, Issue 1
  • DOI: 10.22499/2.6301.001

Arctic sea-ice change: a grand challenge of climate science
journal, January 2010

  • Kattsov, Vladimir M.; Ryabinin, Vladimir E.; Overland, James E.
  • Journal of Glaciology, Vol. 56, Issue 200
  • DOI: 10.3189/002214311796406176

Sea-Ice in Twentieth-Century Simulations by New MIROC Coupled Models: A Comparison between Models with High Resolution and with Ice Thickness Distribution
journal, January 2012

  • Komuro, Yoshiki; Suzuki, Tatsuo; Sakamoto, Takashi T.
  • Journal of the Meteorological Society of Japan, Vol. 90A, Issue 0
  • DOI: 10.2151/jmsj.2012-A11

An enhancement of the NASA Team sea ice algorithm
journal, May 2000

  • Markus, T.; Cavalieri, D. J.
  • IEEE Transactions on Geoscience and Remote Sensing, Vol. 38, Issue 3
  • DOI: 10.1109/36.843033

The HadGEM2 family of Met Office Unified Model Climate configurations
journal, January 2011

  • Bellouin, N.; Collins, W. J.; Culverwell, I. D.
  • Geoscientific Model Development Discussions, Vol. 4, Issue 2
  • DOI: 10.5194/gmdd-4-765-2011

Constraining projections of summer Arctic sea ice
journal, January 2012


Tuning the climate of a global model: TUNING THE CLIMATE OF A GLOBAL MODEL
journal, March 2012

  • Mauritsen, Thorsten; Stevens, Bjorn; Roeckner, Erich
  • Journal of Advances in Modeling Earth Systems, Vol. 4, Issue 3
  • DOI: 10.1029/2012MS000154

Comparison of passive microwave ice concentration algorithm retrievals with AVHRR imagery in arctic peripheral seas
journal, June 2005


Sea-ice extent and its trend provide limited metrics of model performance
journal, January 2014


How well must climate models agree with observations?
journal, October 2015

  • Notz, Dirk
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 373, Issue 2052
  • DOI: 10.1098/rsta.2014.0164

Arctic sea-ice evolution as modeled by Max Planck Institute for Meteorology's Earth system model
journal, April 2013

  • Notz, Dirk; Haumann, F. Alexander; Haak, Helmuth
  • Journal of Advances in Modeling Earth Systems, Vol. 5, Issue 2
  • DOI: 10.1002/jame.20016

Evaluation of the simulation of the annual cycle of Arctic and Antarctic sea ice coverages by 11 major global climate models
journal, January 2006

  • Parkinson, Claire L.; Vinnikov, Konstantin Y.; Cavalieri, Donald J.
  • Journal of Geophysical Research, Vol. 111, Issue C7
  • DOI: 10.1029/2005JC003408

MIROC4h^|^mdash;A New High-Resolution Atmosphere-Ocean Coupled General Circulation Model
journal, January 2012

  • T. Sakamoto, Takashi; Komuro, Yoshiki; Nishimura, Teruyuki
  • Journal of the Meteorological Society of Japan. Ser. II, Vol. 90, Issue 3
  • DOI: 10.2151/jmsj.2012-301

Separating signal and noise in atmospheric temperature changes: The importance of timescale: TEMPERATURE SIGNAL-TO-NOISE RATIOS
journal, November 2011

  • Santer, B. D.; Mears, C.; Doutriaux, C.
  • Journal of Geophysical Research: Atmospheres, Vol. 116, Issue D22
  • DOI: 10.1029/2011JD016263

Configuration and assessment of the GISS ModelE2 contributions to the CMIP5 archive: GISS MODEL-E2 CMIP5 SIMULATIONS
journal, March 2014

  • Schmidt, Gavin A.; Kelley, Max; Nazarenko, Larissa
  • Journal of Advances in Modeling Earth Systems, Vol. 6, Issue 1
  • DOI: 10.1002/2013MS000265

Arctic sea ice area in CMIP3 and CMIP5 climate model ensembles – variability and change
journal, January 2015

  • Semenov, V. A.; Martin, T.; Behrens, L. K.
  • The Cryosphere Discussions, Vol. 9, Issue 1
  • DOI: 10.5194/tcd-9-1077-2015

Assessment of sea ice simulations in the CMIP5 models
journal, January 2015


Trends in Arctic sea ice extent from CMIP5, CMIP3 and observations: ARCTIC SEA ICE EXTENT FROM CMIP5
journal, August 2012

  • Stroeve, Julienne C.; Kattsov, Vladimir; Barrett, Andrew
  • Geophysical Research Letters, Vol. 39, Issue 16
  • DOI: 10.1029/2012GL052676

Summarizing multiple aspects of model performance in a single diagram
journal, April 2001

  • Taylor, Karl E.
  • Journal of Geophysical Research: Atmospheres, Vol. 106, Issue D7
  • DOI: 10.1029/2000JD900719

The CNRM-CM5.1 global climate model: description and basic evaluation
journal, January 2012


Simulating present-day climate with the INMCM4.0 coupled model of the atmospheric and oceanic general circulations
journal, August 2010

  • Volodin, E. M.; Dianskii, N. A.; Gusev, A. V.
  • Izvestiya, Atmospheric and Oceanic Physics, Vol. 46, Issue 4
  • DOI: 10.1134/S000143381004002X

A sea ice free summer Arctic within 30 years: An update from CMIP5 models: SUMMER ARCTIC SEA ICE
journal, September 2012

  • Wang, Muyin; Overland, James E.
  • Geophysical Research Letters, Vol. 39, Issue 18
  • DOI: 10.1029/2012GL052868

How Well does BCC_CSM1.1 Reproduce the 20th Century Climate Change over China?
journal, January 2013


Reproduction of the large-scale state of water and sea ice in the Arctic Ocean in 1948–2002: Part I. Numerical model
journal, June 2009


    Works referencing / citing this record:

    Understanding the Seasonal Cycle of Antarctic Sea Ice Extent in the Context of Longer‐Term Variability
    journal, July 2019

    • Eayrs, Clare; Holland, David; Francis, Diana
    • Reviews of Geophysics, Vol. 57, Issue 3
    • DOI: 10.1029/2018rg000631

    Tropical Teleconnections to Antarctic Sea Ice During Austral Spring 2016 in Coupled Pacemaker Experiments
    journal, June 2019

    • Purich, Ariaan; England, Matthew H.
    • Geophysical Research Letters, Vol. 46, Issue 12
    • DOI: 10.1029/2019gl082671

    Progressing emergent constraints on future climate change
    journal, March 2019


    Towards improved and more routine Earth system model evaluation in CMIP
    journal, January 2016

    • Eyring, Veronika; Gleckler, Peter J.; Heinze, Christoph
    • Earth System Dynamics, Vol. 7, Issue 4
    • DOI: 10.5194/esd-7-813-2016

    Consistent biases in Antarctic sea ice concentration simulated by climate models
    journal, January 2018

    • Roach, Lettie A.; Dean, Samuel M.; Renwick, James A.
    • The Cryosphere, Vol. 12, Issue 1
    • DOI: 10.5194/tc-12-365-2018

    Satellite passive microwave sea-ice concentration data set intercomparison: closed ice and ship-based observations
    journal, January 2019


    Impact of sea ice floe size distribution on seasonal fragmentation and melt of Arctic sea ice
    journal, January 2020

    • Bateson, Adam W.; Feltham, Daniel L.; Schröder, David
    • The Cryosphere, Vol. 14, Issue 2
    • DOI: 10.5194/tc-14-403-2020