skip to main content


Title: LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models

To address the pressing need to better understand the behavior and complex interaction of ice sheets within the global Earth system, significant development of continental-scale, dynamical ice sheet models is underway. Concurrent to the development of the Community Ice Sheet Model (CISM), the corresponding verification and validation (V&V) process is being coordinated through a new, robust, Python-based extensible software package, the Land Ice Verification and Validation toolkit (LIVVkit). Incorporated into the typical ice sheet model development cycle, it provides robust and automated numerical verification, software verification, performance validation, and physical validation analyses on a variety of platforms, from personal laptops to the largest supercomputers. LIVVkit operates on sets of regression test and reference data sets, and provides comparisons for a suite of community prioritized tests, including configuration and parameter variations, bit-for-bit evaluation, and plots of model variables to indicate where differences occur. LIVVkit also provides an easily extensible framework to incorporate and analyze results of new intercomparison projects, new observation data, and new computing platforms. LIVVkit is designed for quick adaptation to additional ice sheet models via abstraction of model specific code, functions, and configurations into an ice sheet model description bundle outside the main LIVVkit structure. Furthermore, through shareablemore » and accessible analysis output, LIVVkit is intended to help developers build confidence in their models and enhance the credibility of ice sheet models overall.« less
ORCiD logo [1] ;  [1] ; ORCiD logo [1] ;  [2] ;  [2] ;  [2] ;  [2] ;  [2] ;  [1] ;  [1] ; ORCiD logo [1]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
  2. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Publication Date:
Grant/Contract Number:
Published Article
Journal Name:
Journal of Advances in Modeling Earth Systems
Additional Journal Information:
Journal Volume: 9; Journal ID: ISSN 1942-2466
American Geophysical Union (AGU)
Research Org:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Org:
USDOE Office of Science (SC)
Country of Publication:
United States
54 ENVIRONMENTAL SCIENCES; 58 GEOSCIENCES; 97 MATHEMATICS AND COMPUTING; verification; validation; LIVVkit; ice sheet; modeling; land ice
OSTI Identifier:
Alternate Identifier(s):
OSTI ID: 1356914; OSTI ID: 1372495