skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Quality control for community-based sea-ice model development

Abstract

A new collaborative organization for sea-ice model development, the CICE Consortium, has devised quality control procedures to maintain the integrity of its numerical codes' physical representations, enabling broad participation from the scientific community in the Consortium's open software development environment. Using output from five coupled and uncoupled configurations of the Los Alamos Sea Ice Model, CICE, we formulate quality control methods that exploit common statistical properties of sea-ice thickness, and test for significant changes in model results in a computationally efficient manner. New additions and changes to CICE are graded into four categories, ranging from bit-for-bit amendments to significant, answer-changing upgrades. These modifications are assessed using criteria that account for the high level of autocorrelation in sea-ice time series, along with a quadratic skill metric that searches for hemispheric changes in model answers across an array of different CICE configurations. These metrics also provide objective guidance for assessing new physical representations and code functionality.

Authors:
ORCiD logo [1]; ORCiD logo [2];  [3];  [4];  [5];  [6];  [7]
  1. Naval Postgraduate School, Monterey, CA (United States)
  2. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
  3. Naval Research Laboratory, Stennis Space Center, MS (United States)
  4. National Center for Atmospheric Research, Boulder, CO (United States)
  5. NOAA Earth System Research Laboratory, Washington, DC (United States)
  6. Recherche en Prévision Numérique Environnementale, Environnement et Changement Climatique Canada Dorval, QC (Canada)
  7. DoD HPCMP PETTT, Engility Corp., Stennis Space Center, MS (United States)
Publication Date:
Research Org.:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE Office of Science (SC). Biological and Environmental Research (BER) (SC-23)
OSTI Identifier:
1467338
Report Number(s):
LA-UR-18-22855
Journal ID: ISSN 1364-503X
Grant/Contract Number:  
AC52-06NA25396; SC0005522; SC0005783
Resource Type:
Accepted Manuscript
Journal Name:
Philosophical Transactions of the Royal Society. A, Mathematical, Physical and Engineering Sciences
Additional Journal Information:
Journal Volume: 376; Journal Issue: 2129; Journal ID: ISSN 1364-503X
Publisher:
The Royal Society Publishing
Country of Publication:
United States
Language:
English
Subject:
58 GEOSCIENCES; Earth Sciences; sea ice, Icepack, earth system modeling, sea ice forecasting

Citation Formats

Roberts, Andrew F., Hunke, Elizabeth C., Allard, Richard, Bailey, David A., Craig, Anthony P., Lemieux, Jean-François, and Turner, Matthew D. Quality control for community-based sea-ice model development. United States: N. p., 2018. Web. doi:10.1098/rsta.2017.0344.
Roberts, Andrew F., Hunke, Elizabeth C., Allard, Richard, Bailey, David A., Craig, Anthony P., Lemieux, Jean-François, & Turner, Matthew D. Quality control for community-based sea-ice model development. United States. doi:10.1098/rsta.2017.0344.
Roberts, Andrew F., Hunke, Elizabeth C., Allard, Richard, Bailey, David A., Craig, Anthony P., Lemieux, Jean-François, and Turner, Matthew D. Mon . "Quality control for community-based sea-ice model development". United States. doi:10.1098/rsta.2017.0344. https://www.osti.gov/servlets/purl/1467338.
@article{osti_1467338,
title = {Quality control for community-based sea-ice model development},
author = {Roberts, Andrew F. and Hunke, Elizabeth C. and Allard, Richard and Bailey, David A. and Craig, Anthony P. and Lemieux, Jean-François and Turner, Matthew D.},
abstractNote = {A new collaborative organization for sea-ice model development, the CICE Consortium, has devised quality control procedures to maintain the integrity of its numerical codes' physical representations, enabling broad participation from the scientific community in the Consortium's open software development environment. Using output from five coupled and uncoupled configurations of the Los Alamos Sea Ice Model, CICE, we formulate quality control methods that exploit common statistical properties of sea-ice thickness, and test for significant changes in model results in a computationally efficient manner. New additions and changes to CICE are graded into four categories, ranging from bit-for-bit amendments to significant, answer-changing upgrades. These modifications are assessed using criteria that account for the high level of autocorrelation in sea-ice time series, along with a quadratic skill metric that searches for hemispheric changes in model answers across an array of different CICE configurations. These metrics also provide objective guidance for assessing new physical representations and code functionality.},
doi = {10.1098/rsta.2017.0344},
journal = {Philosophical Transactions of the Royal Society. A, Mathematical, Physical and Engineering Sciences},
number = 2129,
volume = 376,
place = {United States},
year = {2018},
month = {8}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Figures / Tables:

Table 1 Table 1: Summary of sea ice models used in this study.

Save / Share:

Works referenced in this record:

US Navy Operational Global Ocean and Arctic Ice Prediction Systems
journal, September 2014

  • Metzger, E. Joseph; Smedstad, Ole Martin; Thoppil, Prasad
  • Oceanography, Vol. 27, Issue 3
  • DOI: 10.5670/oceanog.2014.66

A high-resolution ocean and sea-ice modelling system for the Arctic and North Atlantic oceans
journal, January 2015

  • Dupont, F.; Higginson, S.; Bourdallé-Badie, R.
  • Geoscientific Model Development, Vol. 8, Issue 5
  • DOI: 10.5194/gmd-8-1577-2015

An Elastic–Viscous–Plastic Model for Sea Ice Dynamics
journal, September 1997


Viscous–Plastic Sea Ice Dynamics with the EVP Model: Linearization Issues
journal, June 2001


The elastic–viscous–plastic method revisited
journal, November 2013


Impact of a new anisotropic rheology on simulations of Arctic sea ice: IMPACT OF A NEW ANISOTROPIC RHEOLOGY ON SIMULATIONS OF ARCTIC SEA ICE
journal, January 2013

  • Tsamados, M.; Feltham, D. L.; Wilchinsky, A. V.
  • Journal of Geophysical Research: Oceans, Vol. 118, Issue 1
  • DOI: 10.1029/2012JC007990

A Model for the Thermodynamic Growth of Sea Ice in Numerical Investigations of Climate
journal, May 1976


An energy-conserving thermodynamic model of sea ice
journal, July 1999

  • Bitz, C. M.; Lipscomb, William H.
  • Journal of Geophysical Research: Oceans, Vol. 104, Issue C7
  • DOI: 10.1029/1999JC900100

Two modes of sea-ice gravity drainage: A parameterization for large-scale modeling: GRAVITY DRAINAGE
journal, May 2013

  • Turner, Adrian K.; Hunke, Elizabeth C.; Bitz, Cecilia M.
  • Journal of Geophysical Research: Oceans, Vol. 118, Issue 5
  • DOI: 10.1002/jgrc.20171

Improved Sea Ice Shortwave Radiation Physics in CCSM4: The Impact of Melt Ponds and Aerosols on Arctic Sea Ice
journal, March 2012

  • Holland, Marika M.; Bailey, David A.; Briegleb, Bruce P.
  • Journal of Climate, Vol. 25, Issue 5
  • DOI: 10.1175/JCLI-D-11-00078.1

Level-ice melt ponds in the Los Alamos sea ice model, CICE
journal, November 2013


A continuum model of melt pond evolution on Arctic sea ice
journal, January 2007

  • Flocco, Daniela; Feltham, Daniel L.
  • Journal of Geophysical Research, Vol. 112, Issue C8
  • DOI: 10.1029/2006JC003836

Influence of the Sea Ice Thickness Distribution on Polar Climate in CCSM3
journal, June 2006

  • Holland, Marika M.; Bitz, Cecilia M.; Hunke, Elizabeth C.
  • Journal of Climate, Vol. 19, Issue 11
  • DOI: 10.1175/JCLI3751.1

Impacts of a mushy-layer thermodynamic approach in global sea-ice simulations using the CICE sea-ice model
journal, February 2015

  • Turner, Adrian K.; Hunke, Elizabeth C.
  • Journal of Geophysical Research: Oceans, Vol. 120, Issue 2
  • DOI: 10.1002/2014JC010358

Improving the simulation of landfast ice by combining tensile strength and a parameterization for grounded ridges: MODELING LANDFAST ICE
journal, October 2016

  • Lemieux, Jean-François; Dupont, Frédéric; Blain, Philippe
  • Journal of Geophysical Research: Oceans, Vol. 121, Issue 10
  • DOI: 10.1002/2016JC012006

The coastal streamflow flux in the Regional Arctic System Model: COASTAL STREAMFLOW FLUX IN RASM
journal, March 2017

  • Hamman, Joseph; Nijssen, Bart; Roberts, Andrew
  • Journal of Geophysical Research: Oceans, Vol. 122, Issue 3
  • DOI: 10.1002/2016JC012323

Development of the Regional Arctic System Model (RASM): Near-Surface Atmospheric Climate Sensitivity
journal, August 2017

  • Cassano, John J.; DuVivier, Alice; Roberts, Andrew
  • Journal of Climate, Vol. 30, Issue 15
  • DOI: 10.1175/JCLI-D-15-0775.1

Global atmospheric forcing data for Arctic ice-ocean modeling
journal, January 2007

  • Hunke, Elizabeth C.; Holland, Marika M.
  • Journal of Geophysical Research, Vol. 112, Issue C4
  • DOI: 10.1029/2006JC003640

The NCEP Climate Forecast System Reanalysis
journal, August 2010

  • Saha, Suranjana; Moorthi, Shrinivas; Pan, Hua-Lu
  • Bulletin of the American Meteorological Society, Vol. 91, Issue 8
  • DOI: 10.1175/2010BAMS3001.1

The NCEP Climate Forecast System Version 2
journal, March 2014


A global ocean mesh to overcome the North Pole singularity
journal, May 1996

  • Madec, Gurvan; Imbard, Maurice
  • Climate Dynamics, Vol. 12, Issue 6
  • DOI: 10.1007/BF00211684

A Dynamic Thermodynamic Sea Ice Model
journal, July 1979


A new atmospheric dataset for forcing ice-ocean models: Evaluation of reforecasts using the Canadian global deterministic prediction system: CGRF Dataset for Forcing Ice-Ocean Models
journal, July 2013

  • Smith, Gregory C.; Roy, François; Mann, Philip
  • Quarterly Journal of the Royal Meteorological Society, Vol. 140, Issue 680
  • DOI: 10.1002/qj.2194

Simulating transient ice-ocean Ekman transport in the Regional Arctic System Model and Community Earth System Model
journal, January 2015

  • Roberts, Andrew; Craig, Anthony; Maslowski, Wieslaw
  • Annals of Glaciology, Vol. 56, Issue 69
  • DOI: 10.3189/2015AoG69A760

Taking Serial Correlation into Account in Tests of the Mean
journal, February 1995


Modeling M2 tidal variability in Arctic Sea-ice drift and deformation
journal, January 2006


A treatise on frequency spectrum of drift ice velocity
journal, June 2012


Summarizing multiple aspects of model performance in a single diagram
journal, April 2001

  • Taylor, Karl E.
  • Journal of Geophysical Research: Atmospheres, Vol. 106, Issue D7
  • DOI: 10.1029/2000JD900719

Uncertainty quantification and global sensitivity analysis of the Los Alamos sea ice model
journal, April 2016

  • Urrego‐Blanco, Jorge R.; Urban, Nathan M.; Hunke, Elizabeth C.
  • Journal of Geophysical Research: Oceans, Vol. 121, Issue 4
  • DOI: 10.1002/2015JC011558

    Works referencing / citing this record:

    A new atmospheric dataset for forcing ice-ocean models: Evaluation of reforecasts using the Canadian global deterministic prediction system: CGRF Dataset for Forcing Ice-Ocean Models
    journal, July 2013

    • Smith, Gregory C.; Roy, François; Mann, Philip
    • Quarterly Journal of the Royal Meteorological Society, Vol. 140, Issue 680
    • DOI: 10.1002/qj.2194

    Level-ice melt ponds in the Los Alamos sea ice model, CICE
    journal, November 2013


    Modeling M2 tidal variability in Arctic Sea-ice drift and deformation
    journal, January 2006


    The elastic–viscous–plastic method revisited
    journal, November 2013


    Two modes of sea-ice gravity drainage: A parameterization for large-scale modeling: GRAVITY DRAINAGE
    journal, May 2013

    • Turner, Adrian K.; Hunke, Elizabeth C.; Bitz, Cecilia M.
    • Journal of Geophysical Research: Oceans, Vol. 118, Issue 5
    • DOI: 10.1002/jgrc.20171

    A treatise on frequency spectrum of drift ice velocity
    journal, June 2012


    A high-resolution ocean and sea-ice modelling system for the Arctic and North Atlantic oceans
    journal, January 2015

    • Dupont, F.; Higginson, S.; Bourdallé-Badie, R.
    • Geoscientific Model Development, Vol. 8, Issue 5
    • DOI: 10.5194/gmd-8-1577-2015

    Viscous–Plastic Sea Ice Dynamics with the EVP Model: Linearization Issues
    journal, June 2001


    US Navy Operational Global Ocean and Arctic Ice Prediction Systems
    journal, September 2014

    • Metzger, E. Joseph; Smedstad, Ole Martin; Thoppil, Prasad
    • Oceanography, Vol. 27, Issue 3
    • DOI: 10.5670/oceanog.2014.66

      Figures/Tables have been extracted from DOE-funded journal article accepted manuscripts.