The E3SM Diagnostics Package (E3SM Diags v2.7): a Python-based diagnostics package for Earth system model evaluation

Zhang, Chengzhu; Golaz, Jean-Christophe; Forsyth, Ryan; Vo, Tom; Xie, Shaocheng; Shaheen, Zeshawn; Potter, Gerald L.; Asay-Davis, Xylar S.; Zender, Charles S.; Lin, Wuyin; Chen, Chih-Chieh; Terai, Chris R.; Mahajan, Salil; Zhou, Tian; Balaguru, Karthik; Tang, Qi; Tao, Cheng; Zhang, Yuying; Emmenegger, Todd; Burrows, Susannah; Ullrich, Paul A.

doi:10.5194/gmd-15-9031-2022

Title: The E3SM Diagnostics Package (E3SM Diags v2.7): a Python-based diagnostics package for Earth system model evaluation

Journal Article · Tue Dec 20 00:00:00 EST 2022 · Geoscientific Model Development (Online)

DOI:https://doi.org/10.5194/gmd-15-9031-2022· OSTI ID:1905930

Zhang, Chengzhu;

; Forsyth, Ryan; Vo, Tom; Xie, Shaocheng; Shaheen, Zeshawn; Potter, Gerald L.;

;

; Lin, Wuyin; Chen, Chih-Chieh; Terai, Chris R.; Mahajan, Salil;

; Balaguru, Karthik;

; Tao, Cheng; Zhang, Yuying; Emmenegger, Todd;

Abstract. The E3SM Diagnostics Package (E3SM Diags) is a modern, Python-based Earth system model (ESM) evaluation tool (with Python module name e3sm_diags), developed to support the Department of Energy (DOE) Energy Exascale Earth System Model (E3SM). E3SM Diags provides a wide suite of tools for evaluating native E3SM output, as well as ESM data on regular latitude–longitude grids, including output from Coupled Model Intercomparison Project (CMIP) class models. E3SM Diags is modeled after the National Center for Atmospheric Research (NCAR) Atmosphere Model Working Group (AMWG, 2022) diagnostics package. In its version 1 release, E3SM Diags included a set of core essential diagnostics to evaluate the mean physical climate from model simulations. As of version 2.7, more process-oriented and phenomenon-based evaluation diagnostics have been implemented, such as analysis of the quasi-biennial oscillation (QBO), the El Niño–Southern Oscillation (ENSO), streamflow, the diurnal cycle of precipitation, tropical cyclones, ozone and aerosol properties. An in situ dataset from DOE's Atmospheric Radiation Measurement (ARM) program has been integrated into the package for evaluating the representation of simulated cloud and precipitation processes. This tool is designed with enough flexibility to allow for the addition of new observational datasets and new diagnostic algorithms. Additional features include customizable figures; streamlined installation, configuration and execution; and multiprocessing for fast computation. The package uses an up-to-date observational data repository maintained by its developers, where recent datasets are added to the repository as they become available. Finally, several applications for the E3SM Diags module were introduced to fit a diverse set of use cases from the scientific community.

View Journal Article

Cite

Export

Save

Research Organization:: Brookhaven National Laboratory (BNL), Upton, NY (United States); Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States); Los Alamos National Laboratory (LANL), Los Alamos, NM (United States); Pacific Northwest National Laboratory (PNNL), Richland, WA (United States); Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Atmospheric Radiation Measurement (ARM) Data Center

Sponsoring Organization:: USDOE Office of Science (SC), Biological and Environmental Research (BER); USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: E3SM; ARM program; RGMA program; SC0012704; AC52-07NA27344; SC0022070; 89233218CNA000001; AC05-00OR22725

OSTI ID:: 1905930

Alternate ID(s):: OSTI ID: 1877061; OSTI ID: 1909192; OSTI ID: 1909548; OSTI ID: 1958368; OSTI ID: 2005101

Report Number(s):: BNL-223131-2022-JAAM; LLNL-JRNL-831555; LA-UR-22-20631

Journal Information:: Geoscientific Model Development (Online), Journal Name: Geoscientific Model Development (Online) Vol. 15 Journal Issue: 24; ISSN 1991-9603

Publisher:: Copernicus GmbHCopyright Statement

Country of Publication:: Germany

Language:: English

References (65)

Deep Convection and Column Water Vapor over Tropical Land versus Tropical Ocean: A Comparison between the Amazon and the Tropical Western Pacific Schiro, Kathleen A.; Neelin, J. David; Adams, David K. Journal of the Atmospheric Sciences, Vol. 73, Issue 10, p. 4043-4063 https://doi.org/10.1175/JAS-D-16-0119.1	journal	October 2016
The global climatology of an interannually varying air–sea flux data set Large, W. G.; Yeager, S. G. Climate Dynamics, Vol. 33, Issue 2-3 https://doi.org/10.1007/s00382-008-0441-3	journal	August 2008
Arbitrary-Order Conservative and Consistent Remapping and a Theory of Linear Maps: Part I Ullrich, Paul A.; Taylor, Mark A. Monthly Weather Review, Vol. 143, Issue 6 https://doi.org/10.1175/MWR-D-14-00343.1	journal	June 2015
Visualization and Analysis Tools for Ultrascale Climate Data Williams, Dean N. Eos, Transactions American Geophysical Union, Vol. 95, Issue 42 https://doi.org/10.1002/2014EO420002	journal	October 2014
Global Characteristics of Stream Flow Seasonality and Variability Dettinger, Michael D.; Diaz, Henry F. Journal of Hydrometeorology, Vol. 1, Issue 4 https://doi.org/10.1175/1525-7541(2000)001<0289:GCOSFS>2.0.CO;2	journal	August 2000
The ERA5 global reanalysis Hersbach, Hans; Bell, Bill; Berrisford, Paul Quarterly Journal of the Royal Meteorological Society, Vol. 146, Issue 730 https://doi.org/10.1002/qj.3803	journal	June 2020
Characterizing Tropical Cyclones in the Energy Exascale Earth System Model Version 1 Balaguru, Karthik; Leung, L. Ruby; Van Roekel, Luke P. Journal of Advances in Modeling Earth Systems, Vol. 12, Issue 8 https://doi.org/10.1029/2019MS002024	journal	August 2020
Taking climate model evaluation to the next level Eyring, Veronika; Cox, Peter M.; Flato, Gregory M. Nature Climate Change, Vol. 9, Issue 2 https://doi.org/10.1038/s41558-018-0355-y	journal	January 2019
Trends in global tropospheric ozone inferred from a composite record of TOMS/OMI/MLS/OMPS satellite measurements and the MERRA-2 GMI simulation Ziemke, Jerry R.; Oman, Luke D.; Strode, Sarah A. Atmospheric Chemistry and Physics, Vol. 19, Issue 5 https://doi.org/10.5194/acp-19-3257-2019	journal	January 2019
Rainfall Occurrence in the U.S. Warm Season: The Diurnal Cycle Carbone, R. E.; Tuttle, J. D. Journal of Climate, Vol. 21, Issue 16 https://doi.org/10.1175/2008JCLI2275.1	journal	August 2008
The International Land Model Benchmarking (ILAMB) System: Design, Theory, and Implementation Collier, Nathan; Hoffman, Forrest M.; Lawrence, David M. Journal of Advances in Modeling Earth Systems, Vol. 10, Issue 11 https://doi.org/10.1029/2018MS001354	journal	November 2018
A More Powerful Reality Test for Climate Models Gleckler, Peter; Doutriaux, Charles; Durack, Paul Eos, Vol. 97 https://doi.org/10.1029/2016EO051663	journal	May 2016
ESMValTool (v1.0) – a community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP Eyring, Veronika; Righi, Mattia; Lauer, Axel Geoscientific Model Development, Vol. 9, Issue 5 https://doi.org/10.5194/gmd-9-1747-2016	journal	January 2016
Overview of experiment design and comparison of models participating in phase 1 of the SPARC Quasi-Biennial Oscillation initiative (QBOi) Butchart, Neal; Anstey, James A.; Hamilton, Kevin Geoscientific Model Development, Vol. 11, Issue 3 https://doi.org/10.5194/gmd-11-1009-2018	journal	January 2018
Stratospheric Connection to Northern Hemisphere Wintertime Weather: Implications for Prediction Thompson, David W. J.; Baldwin, Mark P.; Wallace, John M. Journal of Climate, Vol. 15, Issue 12 https://doi.org/10.1175/1520-0442(2002)015<1421:SCTNHW>2.0.CO;2	journal	June 2002
African Easterly Wave Variability and Its Relationship to Atlantic Tropical Cyclone Activity Thorncroft, Chris; Hodges, Kevin Journal of Climate, Vol. 14, Issue 6 https://doi.org/10.1175/1520-0442(2001)014<1166:AEWVAI>2.0.CO;2	journal	March 2001
Surface Irradiances of Edition 4.0 Clouds and the Earth’s Radiant Energy System (CERES) Energy Balanced and Filled (EBAF) Data Product Kato, Seiji; Rose, Fred G.; Rutan, David A. Journal of Climate, Vol. 31, Issue 11 https://doi.org/10.1175/JCLI-D-17-0523.1	journal	June 2018
Performance metrics for climate models Gleckler, P. J.; Taylor, K. E.; Doutriaux, C. Journal of Geophysical Research, Vol. 113, Issue D6 https://doi.org/10.1029/2007JD008972	journal	January 2008
The International Best Track Archive for Climate Stewardship (IBTrACS): Unifying Tropical Cyclone Data Knapp, Kenneth R.; Kruk, Michael C.; Levinson, David H. Bulletin of the American Meteorological Society, Vol. 91, Issue 3 https://doi.org/10.1175/2009BAMS2755.1	journal	March 2010
An Introduction to the E3SM Special Collection: Goals, Science Drivers, Development, and Analysis Leung, L. Ruby; Bader, David C.; Taylor, Mark A. Journal of Advances in Modeling Earth Systems, Vol. 12, Issue 11 https://doi.org/10.1029/2019MS001821	journal	November 2020
Teleconnections of the Quasi‐Biennial Oscillation in a multi‐model ensemble of QBO‐resolving models Anstey, James A.; Simpson, Isla R.; Richter, Jadwiga H. Quarterly Journal of the Royal Meteorological Society https://doi.org/10.1002/qj.4048	journal	June 2021
The ERA-Interim reanalysis: configuration and performance of the data assimilation system Dee, D. P.; Uppala, S. M.; Simmons, A. J. Quarterly Journal of the Royal Meteorological Society, Vol. 137, Issue 656 https://doi.org/10.1002/qj.828	journal	April 2011
Impact of the QBO on surface winter climate Marshall, Andrew G.; Scaife, Adam A. Journal of Geophysical Research, Vol. 114, Issue D18 https://doi.org/10.1029/2009JD011737	journal	January 2009
The DOE E3SM Model Version 2: Overview of the physical model Golaz, Jean-Christophe; Van Roekel, Luke P.; Zheng, Xue ESS Open Archive https://doi.org/10.1002/essoar.10511174.1	preprint	April 2022
Climate Data Guide Spurs Discovery and Understanding Schneider, David P.; Deser, Clara; Fasullo, John Eos, Transactions American Geophysical Union, Vol. 94, Issue 13 https://doi.org/10.1002/2013EO130001	journal	March 2013
Tropical cyclones and permanent El Niño in the early Pliocene epoch Fedorov, Alexey V.; Brierley, Christopher M.; Emanuel, Kerry Nature, Vol. 463, Issue 7284 https://doi.org/10.1038/nature08831	journal	February 2010
The Influence of the Quasi-Biennial Oscillation on the Troposphere in Winter in a Hierarchy of Models. Part I: Simplified Dry GCMs Garfinkel, Chaim I.; Hartmann, Dennis L. Journal of the Atmospheric Sciences, Vol. 68, Issue 6 https://doi.org/10.1175/2011JAS3665.1	journal	June 2011
T ROPICAL C YCLONES Emanuel, Kerry Annual Review of Earth and Planetary Sciences, Vol. 31, Issue 1 https://doi.org/10.1146/annurev.earth.31.100901.141259	journal	May 2003
Seasonality of monthly runoff over the continental United States: Causality and relations to mean annual and mean monthly distributions of moisture and energy Petersen, Thomas; Devineni, Naresh; Sankarasubramanian, A. Journal of Hydrology, Vol. 468-469 https://doi.org/10.1016/j.jhydrol.2012.08.028	journal	October 2012
The DOE E3SM Coupled Model Version 1: Overview and Evaluation at Standard Resolution Golaz, Jean‐Christophe; Caldwell, Peter M.; Van Roekel, Luke P. Journal of Advances in Modeling Earth Systems, Vol. 11, Issue 7 https://doi.org/10.1029/2018MS001603	journal	July 2019
Evaluating Diurnal and Semi-Diurnal Cycle of Precipitation in CMIP6 Models Using Satellite- and Ground-Based Observations Tang, Shuaiqi; Gleckler, Peter; Xie, Shaocheng Journal of Climate https://doi.org/10.1175/JCLI-D-20-0639.1	journal	January 2021
Analysis of self-describing gridded geoscience data with netCDF Operators (NCO) Zender, Charles S. Environmental Modelling & Software, Vol. 23, Issue 10-11 https://doi.org/10.1016/j.envsoft.2008.03.004	journal	October 2008
Patterns of similarity of seasonal water balances: A window into streamflow variability over a range of time scales Berghuijs, Wouter R.; Sivapalan, Murugesu; Woods, Ross A. Water Resources Research, Vol. 50, Issue 7 https://doi.org/10.1002/2014WR015692	journal	July 2014
The Global Streamflow Indices and Metadata Archive (GSIM) – Part 1: The production of a daily streamflow archive and metadata Do, Hong Xuan; Gudmundsson, Lukas; Leonard, Michael Earth System Science Data, Vol. 10, Issue 2 https://doi.org/10.5194/essd-10-765-2018	journal	January 2018
Improved Diurnal Cycle of Precipitation in E3SM With a Revised Convective Triggering Function Xie, Shaocheng; Wang, Yi‐Chi; Lin, Wuyin Journal of Advances in Modeling Earth Systems, Vol. 11, Issue 7 https://doi.org/10.1029/2019MS001702	journal	July 2019
The Global Precipitation Climatology Project (GPCP) Monthly Analysis (New Version 2.3) and a Review of 2017 Global Precipitation Adler, Robert; Sapiano, Mathew; Huffman, George Atmosphere, Vol. 9, Issue 4 https://doi.org/10.3390/atmos9040138	journal	April 2018
Arbitrary-Order Conservative and Consistent Remapping and a Theory of Linear Maps: Part II Ullrich, Paul A.; Devendran, Dharshi; Johansen, Hans Monthly Weather Review, Vol. 144, Issue 4 https://doi.org/10.1175/MWR-D-15-0301.1	journal	April 2016
The DOE E3SM Coupled Model Version 1: Description and Results at High Resolution Caldwell, Peter M.; Mametjanov, Azamat; Tang, Qi Journal of Advances in Modeling Earth Systems, Vol. 11, Issue 12 https://doi.org/10.1029/2019MS001870	journal	December 2019
TempestExtremes v2.1: a community framework for feature detection, tracking, and analysis in large datasets Ullrich, Paul A.; Zarzycki, Colin M.; McClenny, Elizabeth E. Geoscientific Model Development, Vol. 14, Issue 8 https://doi.org/10.5194/gmd-14-5023-2021	journal	January 2021
The ARM Data-Oriented Metrics and Diagnostics Package for Climate Models: A New Tool for Evaluating Climate Models with Field Data Zhang, C.; Xie, S.; Tao, C. Bulletin of the American Meteorological Society, Vol. 101, Issue 10 https://doi.org/10.1175/BAMS-D-19-0282.1	journal	October 2020
Global and Regional Aspects of Tropical Cyclone Activity in the CMIP5 Models Camargo, Suzana J. Journal of Climate, Vol. 26, Issue 24 https://doi.org/10.1175/JCLI-D-12-00549.1	journal	December 2013
Global Precipitation and Thunderstorm Frequencies. Part II: Diurnal Variations Dai, Aiguo Journal of Climate, Vol. 14, Issue 6 https://doi.org/10.1175/1520-0442(2001)014<1112:GPATFP>2.0.CO;2	journal	March 2001
Assessing the diurnal cycle of precipitation in a multi-scale climate model Pritchard, Michael S.; Somerville, Richard C. J. Journal of Advances in Modeling Earth Systems, Vol. 2 https://doi.org/10.3894/JAMES.2009.1.12	journal	October 2009
Evaluating Modes of Variability in Climate Models Phillips, Adam S.; Deser, Clara; Fasullo, John Eos, Transactions American Geophysical Union, Vol. 95, Issue 49 https://doi.org/10.1002/2014EO490002	journal	December 2014
ENSO representation in climate models: from CMIP3 to CMIP5 Bellenger, H.; Guilyardi, E.; Leloup, J. Climate Dynamics, Vol. 42, Issue 7-8 https://doi.org/10.1007/s00382-013-1783-z	journal	April 2013
GFDL's CM2 Global Coupled Climate Models. Part III: Tropical Pacific Climate and ENSO Wittenberg, Andrew T.; Rosati, Anthony; Lau, Ngar-Cheung Journal of Climate, Vol. 19, Issue 5 https://doi.org/10.1175/JCLI3631.1	journal	March 2006
Tropical Cyclone–Induced Upper-Ocean Mixing and Climate: Application to Equable Climates Korty, Robert L.; Emanuel, Kerry A.; Scott, Jeffery R. Journal of Climate, Vol. 21, Issue 4 https://doi.org/10.1175/2007JCLI1659.1	journal	February 2008
Earth System Model Evaluation Tool (ESMValTool) v2.0 – technical overview Righi, Mattia; Andela, Bouwe; Eyring, Veronika Geoscientific Model Development, Vol. 13, Issue 3 https://doi.org/10.5194/gmd-13-1179-2020	journal	January 2020
TempestExtremes: a framework for scale-insensitive pointwise feature tracking on unstructured grids Ullrich, Paul A.; Zarzycki, Colin M. Geoscientific Model Development, Vol. 10, Issue 3 https://doi.org/10.5194/gmd-10-1069-2017	journal	January 2017
Array programming with NumPy Harris, Charles R.; Millman, K. Jarrod; van der Walt, Stéfan J. Nature, Vol. 585, Issue 7825 https://doi.org/10.1038/s41586-020-2649-2	journal	September 2020
Impact of the quasi-biennial oscillation on predictability of the Madden–Julian oscillation Marshall, Andrew G.; Hendon, Harry H.; Son, Seok-Woo Climate Dynamics, Vol. 49, Issue 4 https://doi.org/10.1007/s00382-016-3392-0	journal	October 2016
Global analyses of sea surface temperature, sea ice, and night marine air temperature since the late nineteenth century Rayner, N. A. Journal of Geophysical Research, Vol. 108, Issue D14 https://doi.org/10.1029/2002JD002670	journal	January 2003
Evaluation of the interactive stratospheric ozone (O3v2) module in the E3SM version 1 Earth system model Tang, Qi; Prather, Michael J.; Hsu, Juno Geoscientific Model Development, Vol. 14, Issue 3 https://doi.org/10.5194/gmd-14-1219-2021	journal	January 2021
Assessing sensitivities in algorithmic detection of tropical cyclones in climate data: SENSITIVITIES IN ALGORITHMIC TC TRACKING Zarzycki, Colin M.; Ullrich, Paul A. Geophysical Research Letters, Vol. 44, Issue 2 https://doi.org/10.1002/2016GL071606	journal	January 2017
SSM/I Rain Retrievals within a Unified All-Weather Ocean Algorithm Wentz, Frank J.; Spencer, Roy W. Journal of the Atmospheric Sciences, Vol. 55, Issue 9 https://doi.org/10.1175/1520-0469(1998)055<1613:SIRRWA>2.0.CO;2	journal	May 1998
The Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2) Gelaro, Ronald; McCarty, Will; Suárez, Max J. Journal of Climate, Vol. 30, Issue 14 https://doi.org/10.1175/JCLI-D-16-0758.1	journal	July 2017
Process-Oriented Evaluation of Climate and Weather Forecasting Models Maloney, Eric D.; Gettelman, Andrew; Ming, Yi Bulletin of the American Meteorological Society, Vol. 100, Issue 9 https://doi.org/10.1175/BAMS-D-18-0042.1	journal	September 2019
Metrics for the Diurnal Cycle of Precipitation: Toward Routine Benchmarks for Climate Models Covey, Curt; Gleckler, Peter J.; Doutriaux, Charles Journal of Climate, Vol. 29, Issue 12 https://doi.org/10.1175/JCLI-D-15-0664.1	journal	June 2016
COSP: Satellite simulation software for model assessment Bodas-Salcedo, A.; Webb, M. J.; Bony, S. Bulletin of the American Meteorological Society, Vol. 92, Issue 8 https://doi.org/10.1175/2011BAMS2856.1	journal	August 2011
MAC-v1: A new global aerosol climatology for climate studies: MAC-v1 for Climate Studies Kinne, Stefan; O'Donnel, Declan; Stier, Philip Journal of Advances in Modeling Earth Systems, Vol. 5, Issue 4 https://doi.org/10.1002/jame.20035	journal	October 2013
Extra-tropical QBO signals in angular momentum and wave forcing Baldwin, Mark P.; Tung, Ka Kit Geophysical Research Letters, Vol. 21, Issue 24 https://doi.org/10.1029/94GL02119	journal	December 1994
Clouds and the Earth’s Radiant Energy System (CERES) Energy Balanced and Filled (EBAF) Top-of-Atmosphere (TOA) Edition-4.0 Data Product Loeb, Norman G.; Doelling, David R.; Wang, Hailan Journal of Climate, Vol. 31, Issue 2 https://doi.org/10.1175/JCLI-D-17-0208.1	journal	January 2018
Improved Simulation of the QBO in E3SMv1 Richter, Jadwiga H.; Chen, Chih‐Chieh; Tang, Qi Journal of Advances in Modeling Earth Systems, Vol. 11, Issue 11 https://doi.org/10.1029/2019MS001763	journal	November 2019
Progress in Simulating the Quasi‐Biennial Oscillation in CMIP Models Richter, Jadwiga H.; Anstey, James A.; Butchart, Neal Journal of Geophysical Research: Atmospheres, Vol. 125, Issue 8 https://doi.org/10.1029/2019JD032362	journal	April 2020
The TRMM Multisatellite Precipitation Analysis (TMPA): Quasi-Global, Multiyear, Combined-Sensor Precipitation Estimates at Fine Scales Huffman, George J.; Bolvin, David T.; Nelkin, Eric J. Journal of Hydrometeorology, Vol. 8, Issue 1 https://doi.org/10.1175/JHM560.1	journal	February 2007

Similar Records

Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 2: assessing aerosols, clouds, and aerosol–cloud interactions via field campaign and long-term observations

Journal Article · Wed Nov 08 00:00:00 EST 2023 · Geoscientific Model Development (Online) · OSTI ID:1905930

Tang, Shuaiqi; Varble, Adam C.; Fast, Jerome D.; +7 more

Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 1: assessing E3SM aerosol predictions using aircraft, ship, and surface measurements

Journal Article · Wed May 25 00:00:00 EDT 2022 · Geoscientific Model Development (Online) · OSTI ID:1905930

Tang, Shuaiqi; Fast, Jerome D.; Zhang, Kai; +6 more

The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data

Journal Article · Mon Jul 06 00:00:00 EDT 2020 · Bulletin of the American Meteorological Society · OSTI ID:1905930

Zhang, C.; Xie, S.; Tao, C.; +6 more

Related Subjects

54 ENVIRONMENTAL SCIENCES

Title: The E3SM Diagnostics Package (E3SM Diags v2.7): a Python-based diagnostics package for Earth system model evaluation

Citation Formats

References (65)

Similar Records

Related Subjects