LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models
Abstract
To address the pressing need to better understand the behavior and complex interaction of ice sheets within the global Earth system, significant development of continental-scale, dynamical ice sheet models is underway. Concurrent to the development of the Community Ice Sheet Model (CISM), the corresponding verification and validation (V&V) process is being coordinated through a new, robust, Python-based extensible software package, the Land Ice Verification and Validation toolkit (LIVVkit). Incorporated into the typical ice sheet model development cycle, it provides robust and automated numerical verification, software verification, performance validation, and physical validation analyses on a variety of platforms, from personal laptops to the largest supercomputers. LIVVkit operates on sets of regression test and reference data sets, and provides comparisons for a suite of community prioritized tests, including configuration and parameter variations, bit-for-bit evaluation, and plots of model variables to indicate where differences occur. LIVVkit also provides an easily extensible framework to incorporate and analyze results of new intercomparison projects, new observation data, and new computing platforms. LIVVkit is designed for quick adaptation to additional ice sheet models via abstraction of model specific code, functions, and configurations into an ice sheet model description bundle outside the main LIVVkit structure. Furthermore, through shareablemore »
- Authors:
-
[1];
[1];
[1]
- Climate Change Science Institute, Oak Ridge National Laboratory, Oak Ridge Tennessee USA, Computational Sciences and Engineering Division, Oak Ridge National Laboratory, Oak Ridge Tennessee USA
- Los Alamos National Laboratory, Los Alamos, New Mexico USA
- Publication Date:
- Research Org.:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Sponsoring Org.:
- USDOE Office of Science (SC)
- OSTI Identifier:
- 1352451
- Alternate Identifier(s):
- OSTI ID: 1356914; OSTI ID: 1372495
- Grant/Contract Number:
- AC05-00OR22725
- Resource Type:
- Published Article
- Journal Name:
- Journal of Advances in Modeling Earth Systems
- Additional Journal Information:
- Journal Name: Journal of Advances in Modeling Earth Systems Journal Volume: 9 Journal Issue: 2; Journal ID: ISSN 1942-2466
- Publisher:
- American Geophysical Union (AGU)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 54 ENVIRONMENTAL SCIENCES; 58 GEOSCIENCES; 97 MATHEMATICS AND COMPUTING; verification; validation; LIVVkit; ice sheet; modeling; land ice
Citation Formats
Kennedy, Joseph H., Bennett, Andrew R., Evans, Katherine J., Price, Stephen, Hoffman, Matthew, Lipscomb, William H., Fyke, Jeremy, Vargo, Lauren, Boghozian, Adrianna, Norman, Matthew, and Worley, Patrick H. LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models. United States: N. p., 2017.
Web. doi:10.1002/2017MS000916.
Kennedy, Joseph H., Bennett, Andrew R., Evans, Katherine J., Price, Stephen, Hoffman, Matthew, Lipscomb, William H., Fyke, Jeremy, Vargo, Lauren, Boghozian, Adrianna, Norman, Matthew, & Worley, Patrick H. LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models. United States. https://doi.org/10.1002/2017MS000916
Kennedy, Joseph H., Bennett, Andrew R., Evans, Katherine J., Price, Stephen, Hoffman, Matthew, Lipscomb, William H., Fyke, Jeremy, Vargo, Lauren, Boghozian, Adrianna, Norman, Matthew, and Worley, Patrick H. Fri .
"LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models". United States. https://doi.org/10.1002/2017MS000916.
@article{osti_1352451,
title = {LIVVkit: An extensible, python-based, land ice verification and validation toolkit for ice sheet models},
author = {Kennedy, Joseph H. and Bennett, Andrew R. and Evans, Katherine J. and Price, Stephen and Hoffman, Matthew and Lipscomb, William H. and Fyke, Jeremy and Vargo, Lauren and Boghozian, Adrianna and Norman, Matthew and Worley, Patrick H.},
abstractNote = {To address the pressing need to better understand the behavior and complex interaction of ice sheets within the global Earth system, significant development of continental-scale, dynamical ice sheet models is underway. Concurrent to the development of the Community Ice Sheet Model (CISM), the corresponding verification and validation (V&V) process is being coordinated through a new, robust, Python-based extensible software package, the Land Ice Verification and Validation toolkit (LIVVkit). Incorporated into the typical ice sheet model development cycle, it provides robust and automated numerical verification, software verification, performance validation, and physical validation analyses on a variety of platforms, from personal laptops to the largest supercomputers. LIVVkit operates on sets of regression test and reference data sets, and provides comparisons for a suite of community prioritized tests, including configuration and parameter variations, bit-for-bit evaluation, and plots of model variables to indicate where differences occur. LIVVkit also provides an easily extensible framework to incorporate and analyze results of new intercomparison projects, new observation data, and new computing platforms. LIVVkit is designed for quick adaptation to additional ice sheet models via abstraction of model specific code, functions, and configurations into an ice sheet model description bundle outside the main LIVVkit structure. Furthermore, through shareable and accessible analysis output, LIVVkit is intended to help developers build confidence in their models and enhance the credibility of ice sheet models overall.},
doi = {10.1002/2017MS000916},
journal = {Journal of Advances in Modeling Earth Systems},
number = 2,
volume = 9,
place = {United States},
year = {Fri Apr 21 00:00:00 EDT 2017},
month = {Fri Apr 21 00:00:00 EDT 2017}
}
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1002/2017MS000916
https://doi.org/10.1002/2017MS000916
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 6 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
The effect of cavitation on glacier sliding
journal, March 2005
- Schoof, Christian
- Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 461, Issue 2055
CPMIP: measurements of real computational performance of Earth system models in CMIP6
journal, January 2017
- Balaji, Venkatramani; Maisonnave, Eric; Zadeh, Niki
- Geoscientific Model Development, Vol. 10, Issue 1
Engineering the Software for Understanding Climate Change
journal, November 2009
- Easterbrook, Steve M.; Johns, Timothy C.
- Computing in Science & Engineering, Vol. 11, Issue 6
Benchmark experiments for higher-order and full-Stokes ice sheet models (ISMIP–HOM)
journal, January 2008
- Pattyn, F.; Perichon, L.; Aschwanden, A.
- The Cryosphere, Vol. 2, Issue 2
Software verification and validation
conference, January 1996
- Pierce, P.
- IEEE Technical Applications Conference. Northcon/96. Conference Record
Ice-sheet mass balance and climate change
journal, June 2013
- Hanna, Edward; Navarro, Francisco J.; Pattyn, Frank
- Nature, Vol. 498, Issue 7452
The EISMINT benchmarks for testing ice-sheet models
journal, January 1996
- Huybrechts, Philippe; Payne, Tony
- Annals of Glaciology, Vol. 23
Software Development Environments for Scientific and Engineering Software: A Series of Case Studies
conference, May 2007
- Carver, Jeffrey C.; Kendall, Richard P.; Squires, Susan E.
- 29th International Conference on Software Engineering (ICSE'07)
Energy balance of ice streams
journal, January 2000
- Raymond, C. F.
- Journal of Glaciology, Vol. 46, Issue 155
The moral complexity of climate change and the need for a multidisciplinary perspective on climate ethics
journal, February 2015
- Grasso, Marco; Markowitz, Ezra M.
- Climatic Change, Vol. 130, Issue 3
Python for Scientists and Engineers
journal, March 2011
- Millman, K. Jarrod; Aivazis, Michael
- Computing in Science & Engineering, Vol. 13, Issue 2
Climate projections and their impact on policy and practice: Climate projections and their impact on policy and practice
journal, August 2010
- Lemos, Maria Carmen; Rood, Richard B.
- Wiley Interdisciplinary Reviews: Climate Change, Vol. 1, Issue 5
Greenland Surface Mass Balance as Simulated by the Community Earth System Model. Part I: Model Evaluation and 1850–2005 Results
journal, October 2013
- Vizcaíno, Miren; Lipscomb, William H.; Sacks, William J.
- Journal of Climate, Vol. 26, Issue 20