Moving beyond the total sea ice extent in gauging model biases
Abstract
Here, reproducing characteristics of observed sea ice extent remains an important climate modeling challenge. This study describes several approaches to improve how model biases in total sea ice distribution are quantified, and applies them to historically forced simulations contributed to phase 5 of the Coupled Model Intercomparison Project (CMIP5). The quantity of hemispheric total sea ice area, or some measure of its equatorward extent, is often used to evaluate model performance. A new approach is introduced that investigates additional details about the structure of model errors, with an aim to reduce the potential impact of compensating errors when gauging differences between simulated and observed sea ice. Using multiple observational datasets, several new methods are applied to evaluate the climatological spatial distribution and the annual cycle of sea ice cover in 41 CMIP5 models. It is shown that in some models, error compensation can be substantial, for example resulting from too much sea ice in one region and too little in another. Error compensation tends to be larger in models that agree more closely with the observed total sea ice area, which may result from model tuning. The results herein suggest that consideration of only the total hemispheric sea ice areamore »
- Authors:
-
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States); Nansen Environmental and Remote Sensing Center and Bjerknes Centre for Climate Research, Bergen (Norway)
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
- Columbia Univ., New York, NY (United States)
- Publication Date:
- Research Org.:
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1342069
- Report Number(s):
- LLNL-JRNL-680923
Journal ID: ISSN 0894-8755
- Grant/Contract Number:
- AC52-07NA27344
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Climate
- Additional Journal Information:
- Journal Volume: 29; Journal Issue: 24; Journal ID: ISSN 0894-8755
- Publisher:
- American Meteorological Society
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 54 ENVIRONMENTAL SCIENCES; 58 GEOSCIENCES; climate models; coupled models; general circulation models; model comparison; model errors; model evaluation/performance
Citation Formats
Ivanova, Detelina P., Gleckler, Peter J., Taylor, Karl E., Durack, Paul J., and Marvel, Kate D.. Moving beyond the total sea ice extent in gauging model biases. United States: N. p., 2016.
Web. doi:10.1175/JCLI-D-16-0026.1.
Ivanova, Detelina P., Gleckler, Peter J., Taylor, Karl E., Durack, Paul J., & Marvel, Kate D.. Moving beyond the total sea ice extent in gauging model biases. United States. https://doi.org/10.1175/JCLI-D-16-0026.1
Ivanova, Detelina P., Gleckler, Peter J., Taylor, Karl E., Durack, Paul J., and Marvel, Kate D.. Tue .
"Moving beyond the total sea ice extent in gauging model biases". United States. https://doi.org/10.1175/JCLI-D-16-0026.1. https://www.osti.gov/servlets/purl/1342069.
@article{osti_1342069,
title = {Moving beyond the total sea ice extent in gauging model biases},
author = {Ivanova, Detelina P. and Gleckler, Peter J. and Taylor, Karl E. and Durack, Paul J. and Marvel, Kate D.},
abstractNote = {Here, reproducing characteristics of observed sea ice extent remains an important climate modeling challenge. This study describes several approaches to improve how model biases in total sea ice distribution are quantified, and applies them to historically forced simulations contributed to phase 5 of the Coupled Model Intercomparison Project (CMIP5). The quantity of hemispheric total sea ice area, or some measure of its equatorward extent, is often used to evaluate model performance. A new approach is introduced that investigates additional details about the structure of model errors, with an aim to reduce the potential impact of compensating errors when gauging differences between simulated and observed sea ice. Using multiple observational datasets, several new methods are applied to evaluate the climatological spatial distribution and the annual cycle of sea ice cover in 41 CMIP5 models. It is shown that in some models, error compensation can be substantial, for example resulting from too much sea ice in one region and too little in another. Error compensation tends to be larger in models that agree more closely with the observed total sea ice area, which may result from model tuning. The results herein suggest that consideration of only the total hemispheric sea ice area or extent can be misleading when quantitatively comparing how well models agree with observations. Further work is needed to fully develop robust methods to holistically evaluate the ability of models to capture the finescale structure of sea ice characteristics; however, the “sector scale” metric used here aids in reducing the impact of compensating errors in hemispheric integrals.},
doi = {10.1175/JCLI-D-16-0026.1},
journal = {Journal of Climate},
number = 24,
volume = 29,
place = {United States},
year = {2016},
month = {11}
}
Web of Science
Works referenced in this record:
Intercomparison of passive microwave sea ice concentration retrievals over the high-concentration Arctic sea ice
journal, January 2007
- Andersen, Søren; Tonboe, Rasmus; Kaleschke, Lars
- Journal of Geophysical Research, Vol. 112, Issue C8
The Flexible Global Ocean-Atmosphere-Land system model, Spectral Version 2: FGOALS-s2
journal, April 2013
- Bao, Qing; Lin, Pengfei; Zhou, Tianjun
- Advances in Atmospheric Sciences, Vol. 30, Issue 3
The Norwegian Earth System Model, NorESM1-M – Part 1: Description and basic evaluation
journal, January 2012
- Bentsen, M.; Bethke, I.; Debernard, J. B.
- Geoscientific Model Development Discussions, Vol. 5, Issue 3
Antarctic sea-ice thickness and volume estimates from ice charts between 1995 and 1998
journal, January 2015
- Bernstein, E. Rachel; Geiger, Cathleen A.; Deliberty, Tracy L.
- Annals of Glaciology, Vol. 56, Issue 69
The ACCESS coupled model: description, control climate and evaluation
journal, March 2013
- Bi, D.; Dix, M.; Marsland, S.
- Australian Meteorological and Oceanographic Journal, Vol. 63, Issue 1
ACCESS-OM: the ocean and sea-ice core of the ACCESS coupled model
journal, March 2013
- Bi, D.; Marsland, S.; Uotila, P.
- Australian Meteorological and Oceanographic Journal, Vol. 63, Issue 1
Sea Ice Concentrations from Nimbus-7 SMMR and DMSP SSM/I-SSMIS Passive Microwave Data, Version 1
null, January 1996
- Cavalieri, Donald
- NASA National Snow and Ice Data Center Distributed Active Archive Center
Passive microwave algorithms for sea ice concentration: A comparison of two techniques
journal, June 1997
- Comiso, Josefino C.; Cavalieri, Donald J.; Parkinson, Claire L.
- Remote Sensing of Environment, Vol. 60, Issue 3
Climate change projections using the IPSL-CM5 Earth System Model: from CMIP3 to CMIP5
journal, February 2013
- Dufresne, J. -L.; Foujols, M. -A.; Denvil, S.
- Climate Dynamics, Vol. 40, Issue 9-10
GFDL’s ESM2 Global Coupled Climate–Carbon Earth System Models. Part I: Physical Formulation and Baseline Simulation Characteristics
journal, October 2012
- Dunne, John P.; John, Jasmin G.; Adcroft, Alistair J.
- Journal of Climate, Vol. 25, Issue 19
Sea Ice Index, Version 2
dataset, January 2016
- M., Fetterer, F. ; Knowles, K. ; Meier, W. ; Savoie,
- NSIDC
The Community Climate System Model Version 4
journal, October 2011
- Gent, Peter R.; Danabasoglu, Gokhan; Donner, Leo J.
- Journal of Climate, Vol. 24, Issue 19
The simulation of SST, sea ice extents and ocean heat transports in a version of the Hadley Centre coupled model without flux adjustments
journal, February 2000
- Gordon, C.; Cooper, C.; Senior, C. A.
- Climate Dynamics, Vol. 16, Issue 2-3
The GFDL CM3 Coupled Climate Model: Characteristics of the Ocean and Sea Ice Simulations
journal, July 2011
- Griffies, Stephen M.; Winton, Michael; Donner, Leo J.
- Journal of Climate, Vol. 24, Issue 13
EC-Earth V2.2: description and validation of a new seamless earth system prediction model
journal, December 2011
- Hazeleger, W.; Wang, X.; Severijns, C.
- Climate Dynamics, Vol. 39, Issue 11
The Norwegian Earth System Model, NorESM1-M – Part 2: Climate response and scenario projections
journal, January 2012
- Iversen, T.; Bentsen, M.; Bethke, I.
- Geoscientific Model Development Discussions, Vol. 5, Issue 3
Australia's CMIP5 submission using the CSIRO-Mk3.6 model
journal, March 2013
- Jeffrey, S.; Rotstayn, L.; Collier, M.
- Australian Meteorological and Oceanographic Journal, Vol. 63, Issue 1
Arctic sea-ice change: a grand challenge of climate science
journal, January 2010
- Kattsov, Vladimir M.; Ryabinin, Vladimir E.; Overland, James E.
- Journal of Glaciology, Vol. 56, Issue 200
Sea-Ice in Twentieth-Century Simulations by New MIROC Coupled Models: A Comparison between Models with High Resolution and with Ice Thickness Distribution
journal, January 2012
- Komuro, Yoshiki; Suzuki, Tatsuo; Sakamoto, Takashi T.
- Journal of the Meteorological Society of Japan, Vol. 90A, Issue 0
An enhancement of the NASA Team sea ice algorithm
journal, May 2000
- Markus, T.; Cavalieri, D. J.
- IEEE Transactions on Geoscience and Remote Sensing, Vol. 38, Issue 3
The HadGEM2 family of Met Office Unified Model Climate configurations
journal, January 2011
- Bellouin, N.; Collins, W. J.; Culverwell, I. D.
- Geoscientific Model Development Discussions, Vol. 4, Issue 2
Constraining projections of summer Arctic sea ice
journal, January 2012
- Massonnet, F.; Fichefet, T.; Goosse, H.
- The Cryosphere, Vol. 6, Issue 6
Tuning the climate of a global model: TUNING THE CLIMATE OF A GLOBAL MODEL
journal, March 2012
- Mauritsen, Thorsten; Stevens, Bjorn; Roeckner, Erich
- Journal of Advances in Modeling Earth Systems, Vol. 4, Issue 3
Comparison of passive microwave ice concentration algorithm retrievals with AVHRR imagery in arctic peripheral seas
journal, June 2005
- Meier, W. N.
- IEEE Transactions on Geoscience and Remote Sensing, Vol. 43, Issue 6
Sea-ice extent and its trend provide limited metrics of model performance
journal, January 2014
- Notz, D.
- The Cryosphere, Vol. 8, Issue 1
How well must climate models agree with observations?
journal, October 2015
- Notz, Dirk
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 373, Issue 2052
Arctic sea-ice evolution as modeled by Max Planck Institute for Meteorology's Earth system model
journal, April 2013
- Notz, Dirk; Haumann, F. Alexander; Haak, Helmuth
- Journal of Advances in Modeling Earth Systems, Vol. 5, Issue 2
Evaluation of the simulation of the annual cycle of Arctic and Antarctic sea ice coverages by 11 major global climate models
journal, January 2006
- Parkinson, Claire L.; Vinnikov, Konstantin Y.; Cavalieri, Donald J.
- Journal of Geophysical Research, Vol. 111, Issue C7
MIROC4h^|^mdash;A New High-Resolution Atmosphere-Ocean Coupled General Circulation Model
journal, January 2012
- T. Sakamoto, Takashi; Komuro, Yoshiki; Nishimura, Teruyuki
- Journal of the Meteorological Society of Japan. Ser. II, Vol. 90, Issue 3
Separating signal and noise in atmospheric temperature changes: The importance of timescale: TEMPERATURE SIGNAL-TO-NOISE RATIOS
journal, November 2011
- Santer, B. D.; Mears, C.; Doutriaux, C.
- Journal of Geophysical Research: Atmospheres, Vol. 116, Issue D22
Configuration and assessment of the GISS ModelE2 contributions to the CMIP5 archive: GISS MODEL-E2 CMIP5 SIMULATIONS
journal, March 2014
- Schmidt, Gavin A.; Kelley, Max; Nazarenko, Larissa
- Journal of Advances in Modeling Earth Systems, Vol. 6, Issue 1
Arctic sea ice area in CMIP3 and CMIP5 climate model ensembles – variability and change
journal, January 2015
- Semenov, V. A.; Martin, T.; Behrens, L. K.
- The Cryosphere Discussions, Vol. 9, Issue 1
Assessment of sea ice simulations in the CMIP5 models
journal, January 2015
- Shu, Q.; Song, Z.; Qiao, F.
- The Cryosphere, Vol. 9, Issue 1
Trends in Arctic sea ice extent from CMIP5, CMIP3 and observations: ARCTIC SEA ICE EXTENT FROM CMIP5
journal, August 2012
- Stroeve, Julienne C.; Kattsov, Vladimir; Barrett, Andrew
- Geophysical Research Letters, Vol. 39, Issue 16
Summarizing multiple aspects of model performance in a single diagram
journal, April 2001
- Taylor, Karl E.
- Journal of Geophysical Research: Atmospheres, Vol. 106, Issue D7
The CNRM-CM5.1 global climate model: description and basic evaluation
journal, January 2012
- Voldoire, A.; Sanchez-Gomez, E.; Salas y. Mélia, D.
- Climate Dynamics, Vol. 40, Issue 9-10
Simulating present-day climate with the INMCM4.0 coupled model of the atmospheric and oceanic general circulations
journal, August 2010
- Volodin, E. M.; Dianskii, N. A.; Gusev, A. V.
- Izvestiya, Atmospheric and Oceanic Physics, Vol. 46, Issue 4
A sea ice free summer Arctic within 30 years: An update from CMIP5 models: SUMMER ARCTIC SEA ICE
journal, September 2012
- Wang, Muyin; Overland, James E.
- Geophysical Research Letters, Vol. 39, Issue 18
How Well does BCC_CSM1.1 Reproduce the 20th Century Climate Change over China?
journal, January 2013
- Xiao-Ge, Xin; Tong-Wen, Wu; Jiang-Long, Li
- Atmospheric and Oceanic Science Letters, Vol. 6, Issue 1
Reproduction of the large-scale state of water and sea ice in the Arctic Ocean in 1948–2002: Part I. Numerical model
journal, June 2009
- Yakovlev, N. G.
- Izvestiya, Atmospheric and Oceanic Physics, Vol. 45, Issue 3
How does internal variability influence the ability of CMIP5 models to reproduce the recent trend in Southern Ocean sea ice extent?
journal, January 2013
- Zunz, V.; Goosse, H.; Massonnet, F.
- The Cryosphere, Vol. 7, Issue 2
Works referencing / citing this record:
Understanding the Seasonal Cycle of Antarctic Sea Ice Extent in the Context of Longer‐Term Variability
journal, July 2019
- Eayrs, Clare; Holland, David; Francis, Diana
- Reviews of Geophysics, Vol. 57, Issue 3
Tropical Teleconnections to Antarctic Sea Ice During Austral Spring 2016 in Coupled Pacemaker Experiments
journal, June 2019
- Purich, Ariaan; England, Matthew H.
- Geophysical Research Letters, Vol. 46, Issue 12
Progressing emergent constraints on future climate change
journal, March 2019
- Hall, Alex; Cox, Peter; Huntingford, Chris
- Nature Climate Change, Vol. 9, Issue 4
Towards improved and more routine Earth system model evaluation in CMIP
journal, January 2016
- Eyring, Veronika; Gleckler, Peter J.; Heinze, Christoph
- Earth System Dynamics, Vol. 7, Issue 4
Consistent biases in Antarctic sea ice concentration simulated by climate models
journal, January 2018
- Roach, Lettie A.; Dean, Samuel M.; Renwick, James A.
- The Cryosphere, Vol. 12, Issue 1
Satellite passive microwave sea-ice concentration data set intercomparison: closed ice and ship-based observations
journal, January 2019
- Kern, Stefan; Lavergne, Thomas; Notz, Dirk
- The Cryosphere, Vol. 13, Issue 12
Impact of sea ice floe size distribution on seasonal fragmentation and melt of Arctic sea ice
journal, January 2020
- Bateson, Adam W.; Feltham, Daniel L.; Schröder, David
- The Cryosphere, Vol. 14, Issue 2