LIVVkit 2.1: automated and extensible ice sheet model validation

Evans, Katherine J.; Kennedy, Joseph H.; Lu, Dan; Forrester, Mary M.; Price, Stephen; Fyke, Jeremy; Bennett, Andrew R.; Hoffman, Matthew J.; Tezaur, Irina; Zender, Charles S.; Vizcaíno, Miren

doi:10.5194/gmd-12-1067-2019

Title: LIVVkit 2.1: automated and extensible ice sheet model validation

Journal Article · Fri Mar 22 00:00:00 EDT 2019 · Geoscientific Model Development (Online)

DOI:https://doi.org/10.5194/gmd-12-1067-2019· OSTI ID:1505335

^[1];

^[1]; Forrester, Mary M. ^[2];

^[3];

^[4]; Bennett, Andrew R. ^[5];

^[3]; Tezaur, Irina ^[6];

^[7];

^[8]

Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Colorado School of Mines, Golden, CO (United States)
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Los Alamos National Lab. (LANL), Los Alamos, NM (United States); Associated Engineering, Vernon, BC (Canada)
Univ. of Washington, Seattle, WA (United States)
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Univ. of California, Irvine, CA (United States)
Delft Univ. of Technology, Delft (The Netherlands)

A collection of scientific analyses, metrics, and visualizations for robustvalidation of ice sheet models is presented using the Land Ice Verificationand Validation toolkit (LIVVkit), version 2.1, and the LIVVkit Extensionsrepository (LEX), version 0.1. This software collection targets stand-aloneice sheet or coupled Earth system models, and handles datasets and analysesthat require high-performance computing and storage. LIVVkit aims to enableefficient and fully reproducible workflows for postprocessing, analysis, andvisualization of observational and model-derived datasets in a shareableformat, whereby all data, methodologies, and output are distributed to usersfor evaluation. Extending from the initial LIVVkit software framework, wedemonstrate Greenland ice sheet simulation validation metrics using thecoupled Community Earth System Model (CESM) as well as an idealizedstand-alone high-resolution Community Ice Sheet Model, version 2 (CISM2),coupled to the Albany/FELIX velocity solver (CISM-Albany or CISM-A). As oneexample of the capability, LIVVkit analyzes the degree to which modelscapture the surface mass balance (SMB) and identifies potential sources ofbias, using recently available in situ and remotely sensed data ascomparison. Related fields within atmosphere and land surface models, e.g.,surface temperature, radiation, and cloud cover, are also diagnosed. Appliedto the CESM1.0, LIVVkit identifies a positive SMB bias that is focusedlargely around Greenland's southwest region that is due to insufficientablation.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)

Sponsoring Organization:: USDOE Office of Science (SC), Biological and Environmental Research (BER); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)

Grant/Contract Number:: AC05-00OR22725

OSTI ID:: 1505335

Journal Information:: Geoscientific Model Development (Online), Vol. 12, Issue 3; ISSN 1991-9603

Publisher:: European Geosciences UnionCopyright Statement

Country of Publication:: United States

Language:: English

Citation Metrics:

Cited by: 2 works

Citation information provided by
Web of Science

References (52)

Decreasing cloud cover drives the recent mass loss on the Greenland Ice Sheet Hofer, Stefan; Tedstone, Andrew J.; Fettweis, Xavier Science Advances, Vol. 3, Issue 6 https://doi.org/10.1126/sciadv.1700584	journal	June 2017
Greenland surface mass-balance observations from the ice-sheet ablation area and local glaciers Machguth, Horst; Thomsen, Henrik H.; Weidick, Anker Journal of Glaciology, Vol. 62, Issue 235 https://doi.org/10.1017/jog.2016.75	journal	July 2016
Climatology of Total Cloudiness in the Arctic: An Intercomparison of Observations and Reanalyses Chernokulsky, Alexander; Mokhov, Igor I. Advances in Meteorology, Vol. 2012 https://doi.org/10.1155/2012/542093	journal	January 2012
Analysis of self-describing gridded geoscience data with netCDF Operators (NCO) Zender, Charles S. Environmental Modelling & Software, Vol. 23, Issue 10-11 https://doi.org/10.1016/j.envsoft.2008.03.004	journal	October 2008
The rising tide: assessing the risks of climate change and human settlements in low elevation coastal zones McGranahan, Gordon; Balk, Deborah; Anderson, Bridget Environment and Urbanization, Vol. 19, Issue 1 https://doi.org/10.1177/0956247807076960	journal	April 2007
Greenland accumulation: An error model Cogley, J. Graham Journal of Geophysical Research, Vol. 109, Issue D18 https://doi.org/10.1029/2003JD004449	journal	January 2004
Greenland flow variability from ice-sheet-wide velocity mapping Joughin, Ian; Smith, Ben E.; Howat, Ian M. Journal of Glaciology, Vol. 56, Issue 197 https://doi.org/10.3189/002214310792447734	journal	January 2010
LIVVkit: An extensible, python‐based, land ice verification and validation toolkit for ice sheet models Kennedy, Joseph H.; Bennett, Andrew R.; Evans, Katherine J. Journal of Advances in Modeling Earth Systems, Vol. 9, Issue 2 https://doi.org/10.1002/2017MS000916	journal	April 2017
Estimating the Greenland ice sheet surface mass balance contribution to future sea level rise using the regional atmospheric climate model MAR Fettweis, X.; Franco, B.; Tedesco, M. The Cryosphere, Vol. 7, Issue 2 https://doi.org/10.5194/tc-7-469-2013	journal	January 2013
Deeply incised submarine glacial valleys beneath the Greenland ice sheet Morlighem, M.; Rignot, E.; Mouginot, J. Nature Geoscience, Vol. 7, Issue 6 https://doi.org/10.1038/ngeo2167	journal	May 2014
On the Scalability of the Albany/FELIX first-order Stokes Approximation ice Sheet Solver for Large-Scale Simulations of the Greenland and Antarctic ice Sheets Tezaur, Irina K.; Tuminaro, Raymond S.; Perego, Mauro Procedia Computer Science, Vol. 51 https://doi.org/10.1016/j.procs.2015.05.467	journal	January 2015
Arctic synoptic regimes: Comparing domain-wide Arctic cloud observations with CAM4 and CAM5 during similar dynamics: CAM4 AND CAM5 ARCTIC CLOUD EVALUATION Barton, Neil P.; Klein, Stephen A.; Boyle, James S. Journal of Geophysical Research: Atmospheres, Vol. 117, Issue D15 https://doi.org/10.1029/2012JD017589	journal	August 2012
Annual accumulation for Greenland updated using ice core data developed during 2000–2006 and analysis of daily coastal meteorological data Bales, Roger C.; Guo, Qinghua; Shen, Dayong Journal of Geophysical Research, Vol. 114, Issue D6 https://doi.org/10.1029/2008JD011208	journal	January 2009
Evaluation of the updated regional climate model RACMO2.3: summer snowfall impact on the Greenland Ice Sheet Noël, B.; van de Berg, W. J.; van Meijgaard, E. The Cryosphere, Vol. 9, Issue 5 https://doi.org/10.5194/tc-9-1831-2015	journal	January 2015
The Greenland Ice Mapping Project (GIMP) land classification and surface elevation data sets Howat, I. M.; Negrete, A.; Smith, B. E. The Cryosphere, Vol. 8, Issue 4 https://doi.org/10.5194/tc-8-1509-2014	journal	January 2014
Annual Greenland accumulation rates (2009–2012) from airborne snow radar Koenig, Lora S.; Ivanoff, Alvaro; Alexander, Patrick M. The Cryosphere, Vol. 10, Issue 4 https://doi.org/10.5194/tc-10-1739-2016	journal	January 2016
Ice sheet dynamics within an earth system model: downscaling, coupling and first results Barbi, D.; Lohmann, G.; Grosfeld, K. Geoscientific Model Development, Vol. 7, Issue 5 https://doi.org/10.5194/gmd-7-2003-2014	journal	January 2014
Design and results of the ice sheet model initialisation experiments initMIP-Greenland: an ISMIP6 intercomparison Goelzer, Heiko; Nowicki, Sophie; Edwards, Tamsin The Cryosphere, Vol. 12, Issue 4 https://doi.org/10.5194/tc-12-1433-2018	journal	January 2018
Accumulation over the Greenland ice sheet from historical and recent records Bales, Roger C.; McConnell, Joseph R.; Mosley-Thompson, Ellen Journal of Geophysical Research: Atmospheres, Vol. 106, Issue D24 https://doi.org/10.1029/2001JD900153	journal	December 2001
Generalizing a Data Analysis Pipeline in the Cloud to Handle Diverse Use Cases in NASA's EOSDIS Lynnes, Christopher; Ramachandran, Rahul IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium https://doi.org/10.1109/IGARSS.2018.8519178	conference	July 2018
A synthesis of the basal thermal state of the Greenland Ice Sheet: GREENLAND BASAL THERMAL STATE MacGregor, Joseph A.; Fahnestock, Mark A.; Catania, Ginny A. Journal of Geophysical Research: Earth Surface, Vol. 121, Issue 7 https://doi.org/10.1002/2015JF003803	journal	July 2016
Coupled ice sheet–climate modeling under glacial and pre-industrial boundary conditions Ziemen, F. A.; Rodehacke, C. B.; Mikolajewicz, U. Climate of the Past, Vol. 10, Issue 5 https://doi.org/10.5194/cp-10-1817-2014	journal	January 2014
The CCSM4 Land Simulation, 1850–2005: Assessment of Surface Climate and New Capabilities Lawrence, David M.; Oleson, Keith W.; Flanner, Mark G. Journal of Climate, Vol. 25, Issue 7 https://doi.org/10.1175/JCLI-D-11-00103.1	journal	April 2012
Albany/FELIX : a parallel, scalable and robust, finite element, first-order Stokes approximation ice sheet solver built for advanced analysis Tezaur, I. K.; Perego, M.; Salinger, A. G. Geoscientific Model Development, Vol. 8, Issue 4 https://doi.org/10.5194/gmd-8-1197-2015	journal	January 2015
BedMachine v3: Complete Bed Topography and Ocean Bathymetry Mapping of Greenland From Multibeam Echo Sounding Combined With Mass Conservation Morlighem, M.; Williams, C. N.; Rignot, E. Geophysical Research Letters, Vol. 44, Issue 21 https://doi.org/10.1002/2017GL074954	journal	November 2017
Ice-Sheet Dynamics Schoof, Christian; Hewitt, Ian Annual Review of Fluid Mechanics, Vol. 45, Issue 1 https://doi.org/10.1146/annurev-fluid-011212-140632	journal	January 2013
OSTIA : An operational, high resolution, real time, global sea surface temperature analysis system Stark, John D.; Donlon, Craig J.; Martin, Matthew J. OCEANS 2007 - Europe https://doi.org/10.1109/OCEANSE.2007.4302251	conference	June 2007
An ice sheet model validation framework for the Greenland ice sheet Price, Stephen F.; Hoffman, Matthew J.; Bonin, Jennifer A. Geoscientific Model Development, Vol. 10, Issue 1 https://doi.org/10.5194/gmd-10-255-2017	journal	January 2017
Regional Greenland accumulation variability from Operation IceBridge airborne accumulation radar Lewis, Gabriel; Osterberg, Erich; Hawley, Robert The Cryosphere, Vol. 11, Issue 2 https://doi.org/10.5194/tc-11-773-2017	journal	January 2017
Complex Greenland outlet glacier flow captured Aschwanden, Andy; Fahnestock, Mark A.; Truffer, Martin Nature Communications, Vol. 7, Issue 1 https://doi.org/10.1038/ncomms10524	journal	February 2016
Clouds enhance Greenland ice sheet meltwater runoff Van Tricht, K.; Lhermitte, S.; Lenaerts, J. T. M. Nature Communications, Vol. 7, Issue 1 https://doi.org/10.1038/ncomms10266	journal	January 2016
Greenland annual accumulation along the EGIG line, 1959–2004, from ASIRAS airborne radar and neutron-probe density measurements Overly, Thomas B.; Hawley, Robert L.; Helm, Veit The Cryosphere, Vol. 10, Issue 4 https://doi.org/10.5194/tc-10-1679-2016	journal	January 2016
The ERA-Interim reanalysis: configuration and performance of the data assimilation system Dee, D. P.; Uppala, S. M.; Simmons, A. J. Quarterly Journal of the Royal Meteorological Society, Vol. 137, Issue 656 https://doi.org/10.1002/qj.828	journal	April 2011
Continental scale, high order, high spatial resolution, ice sheet modeling using the Ice Sheet System Model (ISSM): ICE SHEET SYSTEM MODEL Larour, E.; Seroussi, H.; Morlighem, M. Journal of Geophysical Research: Earth Surface, Vol. 117, Issue F1 https://doi.org/10.1029/2011JF002140	journal	March 2012
New precipitation and accumulation maps for Greenland Ohmura, Atsumu; Reeh, Niels Journal of Glaciology, Vol. 37, Issue 125 https://doi.org/10.1017/S0022143000042891	journal	January 1991
Polar clouds and radiation in satellite observations, reanalyses, and climate models: POLAR CLOUDS AND RADIATION Lenaerts, Jan T. M.; Van Tricht, Kristof; Lhermitte, Stef Geophysical Research Letters, Vol. 44, Issue 7 https://doi.org/10.1002/2016GL072242	journal	April 2017
The Mean Climate of the Community Atmosphere Model (CAM4) in Forced SST and Fully Coupled Experiments Neale, Richard B.; Richter, Jadwiga; Park, Sungsu Journal of Climate, Vol. 26, Issue 14 https://doi.org/10.1175/JCLI-D-12-00236.1	journal	July 2013
Ice Sheet Model Intercomparison Project (ISMIP6) contribution to CMIP6 Nowicki, Sophie M. J.; Payne, Anthony; Larour, Eric Geoscientific Model Development, Vol. 9, Issue 12 https://doi.org/10.5194/gmd-9-4521-2016	journal	January 2016
The Glimmer community ice sheet model Rutt, I. C.; Hagdorn, M.; Hulton, N. R. J. Journal of Geophysical Research, Vol. 114, Issue F2 https://doi.org/10.1029/2008JF001015	journal	January 2009
Twenty-one years of mass balance observations along the K-transect, West Greenland van de Wal, R. S. W.; Boot, W.; Smeets, C. J. P. P. Earth System Science Data, Vol. 4, Issue 1 https://doi.org/10.5194/essd-4-31-2012	journal	January 2012
Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale Mahajan, Salil; Gaddis, Abigail L.; Evans, Katherine J. Procedia Computer Science, Vol. 108 https://doi.org/10.1016/j.procs.2017.05.259	journal	January 2017
Greenland Surface Mass Balance as Simulated by the Community Earth System Model. Part I: Model Evaluation and 1850–2005 Results Vizcaíno, Miren; Lipscomb, William H.; Sacks, William J. Journal of Climate, Vol. 26, Issue 20 https://doi.org/10.1175/JCLI-D-12-00615.1	journal	October 2013
Cloud influence on and response to seasonal Arctic sea ice loss Kay, Jennifer E.; Gettelman, Andrew Journal of Geophysical Research, Vol. 114, Issue D18 https://doi.org/10.1029/2009JD011773	journal	January 2009
Contemporary (1960–2012) Evolution of the Climate and Surface Mass Balance of the Greenland Ice Sheet van Angelen, J. H.; van den Broeke, M. R.; Wouters, B. Surveys in Geophysics, Vol. 35, Issue 5 https://doi.org/10.1007/s10712-013-9261-z	journal	November 2013
Implementation and Initial Evaluation of the Glimmer Community Ice Sheet Model in the Community Earth System Model Lipscomb, William H.; Fyke, Jeremy G.; Vizcaíno, Miren Journal of Climate, Vol. 26, Issue 19 https://doi.org/10.1175/JCLI-D-12-00557.1	journal	October 2013
Optimal initial conditions for coupling ice sheet models to Earth system models: PEREGO ET AL. Perego, Mauro; Price, Stephen; Stadler, Georg Journal of Geophysical Research: Earth Surface, Vol. 119, Issue 9 https://doi.org/10.1002/2014JF003181	journal	September 2014
Ice sheets as interactive components of Earth System Models: progress and challenges: Ice sheets as interactive components of Earth System Models Vizcaino, Miren Wiley Interdisciplinary Reviews: Climate Change, Vol. 5, Issue 4 https://doi.org/10.1002/wcc.285	journal	May 2014
Estimating the Greenland ice sheet surface mass balance contribution to future sea level rise using the regional atmospheric climate model MAR Fettweis, X.; Franco, B.; Tedesco, Marco Columbia University https://doi.org/10.7916/d8028rg4	null	January 2013
Decreasing cloud cover drives the recent mass loss on the Greenland Ice Sheet Hofer, Stefan; Tedstone, Andrew; Fettweis, Xavier EarthArXiv https://doi.org/10.17605/osf.io/wrqb9	text	January 2017
Annual Greenland accumulation rates (2009–2012) from airborne snow radar Koenig, Lora S.; Ivanoff, Alvaro; Alexander, Patrick M. Columbia University https://doi.org/10.7916/d8x07kht	text	January 2016
New precipitation and accumulation maps for Greenland Ohmura, Atsumu; Reeh, Niels Journal of Glaciology, Vol. 37, Issue 125 https://doi.org/10.3189/s0022143000042891	journal	January 1991
Greenland surface mass-balance observations from the ice-sheet ablation area and local glaciers Horst, Machguth,; H., Thomsen, Henrik; Anker, weidick, International Glaciological Society https://doi.org/10.5167/uzh-126156	text	January 2016

Cited By (2)

A Study on the Performance Portability of the Finite Element Assembly Process Within the Albany Land Ice Solver Watkins, Jerry; Tezaur, Irina; Demeshko, Irina Numerical Methods for Flows: FEF 2017 Selected Contributions, p. 177-188 https://doi.org/10.1007/978-3-030-30705-9_16	book	February 2020
Regional grid refinement in an Earth system model: impacts on the simulated Greenland surface mass balance van Kampenhout, Leonardus; Rhoades, Alan M.; Herrington, Adam R. The Cryosphere, Vol. 13, Issue 6 https://doi.org/10.5194/tc-13-1547-2019	journal	January 2019

Similar Records

LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models

Journal Article · Fri Apr 21 00:00:00 EDT 2017 · Journal of Advances in Modeling Earth Systems · OSTI ID:1505335

Kennedy, Joseph H.; Bennett, Andrew R.; Evans, Katherine J.; +8 more

Implementation and Initial Evaluation of the Glimmer Community Ice Sheet Model in the Community Earth System Model

Journal Article · Tue Sep 24 00:00:00 EDT 2013 · Journal of Climate · OSTI ID:1505335

Lipscomb, William H.; Fyke, Jeremy G.; Vizcaíno, Miren; +6 more

Description and Demonstration of the Coupled Community Earth System Model v2 – Community Ice Sheet Model v2 (CESM2‐CISM2)

Journal Article · Thu Jun 24 00:00:00 EDT 2021 · Journal of Advances in Modeling Earth Systems · OSTI ID:1505335

Muntjewerf, Laura; Sacks, William J.; Lofverstrom, Marcus; +7 more

Related Subjects

58 GEOSCIENCES

Title: LIVVkit 2.1: automated and extensible ice sheet model validation

Citation Formats

References (52)

Cited By (2)

Similar Records

Related Subjects