Search Menu
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information
Search Scholarly Publications

Title: The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data

Abstract

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program User Facility produces ground-based long-term continuous unique measurements for atmospheric state, precipitation, turbulent fluxes, radiation, aerosol, cloud and the land surface, which are collected at multiple sites. These comprehensive datasets have been widely used to calibrate climate models and are proven to be invaluable for climate model development and improvement. This article introduces an evaluation package to facilitate the use of ground-based ARM measurements in climate model evaluation. The ARM data-oriented metrics and diagnostics package (ARM-DIAGS) includes both ARM observational datasets and a Python-based analysis toolkit for computation and visualization. The observational datasets are compiled from multiple ARM data products and specifically tailored for use in climate model evaluation. In addition, ARM-DIAGS also includes simulation data from models participating the Coupled Model Inter-comparison Project (CMIP), which will allow climate-modeling groups to compare a new, candidate version of their model to existing CMIP models. The analysis toolkit is designed to make the metrics and diagnostics quickly available to the model developers.

Authors:
 [1];  [1];  [1];  [1];  [2];  [3];  [4]; ORCiD logo [5];  [1]
+ Show Author Affiliations
  1. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
  2. Univ. of California, Los Angeles, CA (United States)
  3. University of California, Los Angeles, California
  4. California Institute of Technology (CalTech), Pasadena, CA (United States). Jet Propulsion Lab. (JPL)
  5. Brookhaven National Lab. (BNL), Upton, NY (United States)
Publication Date:
Research Org.:
Brookhaven National Lab. (BNL), Upton, NY (United States); Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC), Biological and Environmental Research (BER); National Science Foundation (NSF)
OSTI Identifier:
1635462
Alternate Identifier(s):
OSTI ID: 1830485
Report Number(s):
BNL-216090-2020-JAAM; LLNL-JRNL-818708
Journal ID: ISSN 0003-0007
Grant/Contract Number:  
SC0012704; AC52-07NA27344; SC0011074; B634021; AGS-1540518; AGS-1936810
Resource Type:
Accepted Manuscript
Journal Name:
Bulletin of the American Meteorological Society
Additional Journal Information:
Journal Volume: 101; Journal Issue: 10; Journal ID: ISSN 0003-0007
Publisher:
American Meteorological Society
Country of Publication:
United States
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES

Citation Formats

Zhang, C., Xie, S., Tao, C., Tang, S., Emmenegger, T., Neelin, J. D., Schiro, K. A., Lin, Wuyin, and Shaheen, Z. The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data. United States: N. p., 2020. Web. doi:10.1175/BAMS-D-19-0282.1.
Copy to clipboard
Zhang, C., Xie, S., Tao, C., Tang, S., Emmenegger, T., Neelin, J. D., Schiro, K. A., Lin, Wuyin, & Shaheen, Z. The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data. United States. https://doi.org/10.1175/BAMS-D-19-0282.1
Copy to clipboard
Zhang, C., Xie, S., Tao, C., Tang, S., Emmenegger, T., Neelin, J. D., Schiro, K. A., Lin, Wuyin, and Shaheen, Z. Mon . "The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data". United States. https://doi.org/10.1175/BAMS-D-19-0282.1. https://www.osti.gov/servlets/purl/1635462.
Copy to clipboard
@article{osti_1635462,
title = {The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data},
author = {Zhang, C. and Xie, S. and Tao, C. and Tang, S. and Emmenegger, T. and Neelin, J. D. and Schiro, K. A. and Lin, Wuyin and Shaheen, Z.},
abstractNote = {The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program User Facility produces ground-based long-term continuous unique measurements for atmospheric state, precipitation, turbulent fluxes, radiation, aerosol, cloud and the land surface, which are collected at multiple sites. These comprehensive datasets have been widely used to calibrate climate models and are proven to be invaluable for climate model development and improvement. This article introduces an evaluation package to facilitate the use of ground-based ARM measurements in climate model evaluation. The ARM data-oriented metrics and diagnostics package (ARM-DIAGS) includes both ARM observational datasets and a Python-based analysis toolkit for computation and visualization. The observational datasets are compiled from multiple ARM data products and specifically tailored for use in climate model evaluation. In addition, ARM-DIAGS also includes simulation data from models participating the Coupled Model Inter-comparison Project (CMIP), which will allow climate-modeling groups to compare a new, candidate version of their model to existing CMIP models. The analysis toolkit is designed to make the metrics and diagnostics quickly available to the model developers.},
doi = {10.1175/BAMS-D-19-0282.1},
journal = {Bulletin of the American Meteorological Society},
number = 10,
volume = 101,
place = {United States},
year = {Mon Jul 06 00:00:00 EDT 2020},
month = {Mon Jul 06 00:00:00 EDT 2020}
}
Copy to clipboard
Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1175/BAMS-D-19-0282.1
Copyright Statement
Other availability
Search WorldCat Search WorldCat to find libraries that may hold this journal
Save / Share:
Export Metadata
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.

Works referenced in this record:

The ARM Cloud Radar Simulator for Global Climate Models: Bridging Field Data and Climate Models
journal, January 2018

  • Zhang, Yuying; Xie, Shaocheng; Klein, Stephen A.
  • Bulletin of the American Meteorological Society, Vol. 99, Issue 1
  • DOI: 10.1175/BAMS-D-16-0258.1

Deep Convection and Column Water Vapor over Tropical Land versus Tropical Ocean: A Comparison between the Amazon and the Tropical Western Pacific
journal, October 2016

  • Schiro, Kathleen A.; Neelin, J. David; Adams, David K.
  • Journal of the Atmospheric Sciences, Vol. 73, Issue 10, p. 4043-4063
  • DOI: 10.1175/JAS-D-16-0119.1

CLOUDS AND MORE: ARM Climate Modeling Best Estimate Data: A New Data Product for Climate Studies
journal, January 2010

  • Xie, Shaocheng; McCoy, Renata B.; Klein, Stephen A.
  • Bulletin of the American Meteorological Society, Vol. 91, Issue 1
  • DOI: 10.1175/2009BAMS2891.1

Improved Diurnal Cycle of Precipitation in E3SM With a Revised Convective Triggering Function
journal, July 2019

  • Xie, Shaocheng; Wang, Yi‐Chi; Lin, Wuyin
  • Journal of Advances in Modeling Earth Systems, Vol. 11, Issue 7
  • DOI: 10.1029/2019MS001702

Process-Oriented Evaluation of Climate and Weather Forecasting Models
journal, September 2019

  • Maloney, Eric D.; Gettelman, Andrew; Ming, Yi
  • Bulletin of the American Meteorological Society, Vol. 100, Issue 9
  • DOI: 10.1175/BAMS-D-18-0042.1

Convective Transition Statistics over Tropical Oceans for Climate Model Diagnostics: GCM Evaluation
journal, January 2020

  • Kuo, Yi-Hung; Neelin, J. David; Chen, Chih-Chieh
  • Journal of the Atmospheric Sciences, Vol. 77, Issue 1
  • DOI: 10.1175/JAS-D-19-0132.1

Metrics for the Diurnal Cycle of Precipitation: Toward Routine Benchmarks for Climate Models
journal, June 2016

  • Covey, Curt; Gleckler, Peter J.; Doutriaux, Charles
  • Journal of Climate, Vol. 29, Issue 12
  • DOI: 10.1175/JCLI-D-15-0664.1

CAUSES: Diagnosis of the Summertime Warm Bias in CMIP5 Climate Models at the ARM Southern Great Plains Site
journal, March 2018

  • Zhang, Chengzhu; Xie, Shaocheng; Klein, Stephen A.
  • Journal of Geophysical Research: Atmospheres, Vol. 123, Issue 6
  • DOI: 10.1002/2017JD027200

Two Modes of Change of the Distribution of Rain
journal, November 2014

Toward understanding of differences in current cloud retrievals of ARM ground-based measurements: UNDERSTANDING CLOUD RETRIEVAL DIFFERENCE
journal, May 2012

  • Zhao, Chuanfeng; Xie, Shaocheng; Klein, Stephen A.
  • Journal of Geophysical Research: Atmospheres, Vol. 117, Issue D10
  • DOI: 10.1029/2011JD016792

Low‐cloud characteristics over the tropical western Pacific from ARM observations and CAM5 simulations
journal, September 2015

  • Chandra, Arunchandra S.; Zhang, Chidong; Klein, Stephen A.
  • Journal of Geophysical Research: Atmospheres, Vol. 120, Issue 17
  • DOI: 10.1002/2015JD023369

Convective Transition Statistics over Tropical Oceans for Climate Model Diagnostics: Observational Baseline
journal, May 2018

  • Kuo, Yi-Hung; Schiro, Kathleen A.; Neelin, J. David
  • Journal of the Atmospheric Sciences, Vol. 75, Issue 5
  • DOI: 10.1175/JAS-D-17-0287.1

An Automated Quality Assessment and Control Algorithm for Surface Radiation Measurements
journal, April 2008

Summarizing multiple aspects of model performance in a single diagram
journal, April 2001

  • Taylor, Karl E.
  • Journal of Geophysical Research: Atmospheres, Vol. 106, Issue D7
  • DOI: 10.1029/2000JD900719
    Sort by:
    [ × clear filter / sort ]

    Similar Records in DOE PAGES and OSTI.GOV collections: