skip to main content

DOE PAGESDOE PAGES

Title: LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models

To address the pressing need to better understand the behavior and complex interaction of ice sheets within the global Earth system, significant development of continental-scale, dynamical ice sheet models is underway. Concurrent to the development of the Community Ice Sheet Model (CISM), the corresponding verification and validation (V&V) process is being coordinated through a new, robust, Python-based extensible software package, the Land Ice Verification and Validation toolkit (LIVVkit). Incorporated into the typical ice sheet model development cycle, it provides robust and automated numerical verification, software verification, performance validation, and physical validation analyses on a variety of platforms, from personal laptops to the largest supercomputers. LIVVkit operates on sets of regression test and reference data sets, and provides comparisons for a suite of community prioritized tests, including configuration and parameter variations, bit-for-bit evaluation, and plots of model variables to indicate where differences occur. LIVVkit also provides an easily extensible framework to incorporate and analyze results of new intercomparison projects, new observation data, and new computing platforms. LIVVkit is designed for quick adaptation to additional ice sheet models via abstraction of model specific code, functions, and configurations into an ice sheet model description bundle outside the main LIVVkit structure. Furthermore, through shareablemore » and accessible analysis output, LIVVkit is intended to help developers build confidence in their models and enhance the credibility of ice sheet models overall.« less
Authors:
ORCiD logo [1] ;  [1] ; ORCiD logo [1] ;  [2] ;  [2] ;  [2] ;  [2] ;  [2] ;  [1] ;  [1] ; ORCiD logo [1]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
  2. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Publication Date:
Grant/Contract Number:
AC05-00OR22725
Type:
Published Article
Journal Name:
Journal of Advances in Modeling Earth Systems
Additional Journal Information:
Journal Volume: 9; Journal ID: ISSN 1942-2466
Publisher:
American Geophysical Union (AGU)
Research Org:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Org:
USDOE Office of Science (SC)
Country of Publication:
United States
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES; 58 GEOSCIENCES; 97 MATHEMATICS AND COMPUTING; verification; validation; LIVVkit; ice sheet; modeling; land ice
OSTI Identifier:
1352451
Alternate Identifier(s):
OSTI ID: 1356914; OSTI ID: 1372495

Kennedy, Joseph H., Bennett, Andrew R., Evans, Katherine J., Price, Stephen, Hoffman, Matthew, Lipscomb, William H., Fyke, Jeremy, Vargo, Lauren, Boghozian, Adrianna, Norman, Matthew, and Worley, Patrick H.. LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models. United States: N. p., Web. doi:10.1002/2017MS000916.
Kennedy, Joseph H., Bennett, Andrew R., Evans, Katherine J., Price, Stephen, Hoffman, Matthew, Lipscomb, William H., Fyke, Jeremy, Vargo, Lauren, Boghozian, Adrianna, Norman, Matthew, & Worley, Patrick H.. LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models. United States. doi:10.1002/2017MS000916.
Kennedy, Joseph H., Bennett, Andrew R., Evans, Katherine J., Price, Stephen, Hoffman, Matthew, Lipscomb, William H., Fyke, Jeremy, Vargo, Lauren, Boghozian, Adrianna, Norman, Matthew, and Worley, Patrick H.. 2017. "LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models". United States. doi:10.1002/2017MS000916.
@article{osti_1352451,
title = {LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models},
author = {Kennedy, Joseph H. and Bennett, Andrew R. and Evans, Katherine J. and Price, Stephen and Hoffman, Matthew and Lipscomb, William H. and Fyke, Jeremy and Vargo, Lauren and Boghozian, Adrianna and Norman, Matthew and Worley, Patrick H.},
abstractNote = {To address the pressing need to better understand the behavior and complex interaction of ice sheets within the global Earth system, significant development of continental-scale, dynamical ice sheet models is underway. Concurrent to the development of the Community Ice Sheet Model (CISM), the corresponding verification and validation (V&V) process is being coordinated through a new, robust, Python-based extensible software package, the Land Ice Verification and Validation toolkit (LIVVkit). Incorporated into the typical ice sheet model development cycle, it provides robust and automated numerical verification, software verification, performance validation, and physical validation analyses on a variety of platforms, from personal laptops to the largest supercomputers. LIVVkit operates on sets of regression test and reference data sets, and provides comparisons for a suite of community prioritized tests, including configuration and parameter variations, bit-for-bit evaluation, and plots of model variables to indicate where differences occur. LIVVkit also provides an easily extensible framework to incorporate and analyze results of new intercomparison projects, new observation data, and new computing platforms. LIVVkit is designed for quick adaptation to additional ice sheet models via abstraction of model specific code, functions, and configurations into an ice sheet model description bundle outside the main LIVVkit structure. Furthermore, through shareable and accessible analysis output, LIVVkit is intended to help developers build confidence in their models and enhance the credibility of ice sheet models overall.},
doi = {10.1002/2017MS000916},
journal = {Journal of Advances in Modeling Earth Systems},
number = ,
volume = 9,
place = {United States},
year = {2017},
month = {3}
}