DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A global coupled ensemble data assimilation system using the Community Earth System Model and the Data Assimilation Research Testbed

Abstract

This paper presents a description of the CESM/DART ensemble coupled data assimilation (DA) system based on the Community Earth System Model (CESM) and the Data Assimilation Research Testbed (DART) assimilation software. The CESM/DART should be viewed as a flexible system to support the DA needs of the CESM research community and not as a static reanalysis product. In this implementation of the CESM/DART, conventional insitu observations of the ocean and atmosphere are assimilated into the respective component models of the CESM using a 30‐member ensemble adjustment Kalman filter (EAKF). CESM/DART is run in a “weakly coupled” configuration wherein observations native to each climate system component only directly impact the state vector for that component. Information is passed between components indirectly through the short‐term coupled model forecasts that provide the EAKF background ensemble. This system leverages previous ensemble DA development for the Community Atmosphere Model and Parallel Ocean Program models using the DART EAKF. The CESM/DART project is a step towards providing increasingly useful DA capabilities for the CESM research community. Results are presented for our prototype 12‐year reanalysis, run from 1970 to mid 1982. Multiple lines of evidence demonstrate that the system is capable of constraining the CESM coupled modelmore » to simulate the historical variability of the climate system in the well‐observed Northern Hemisphere. A collection of monthly average variables, climate mode indices, observation diagnostics and snapshots of synoptic weather in the ocean and atmosphere are compared to established datasets, showing especially good agreement in the Northern Hemisphere. A discussion of the CESM/DART as a modular, community facility and the benefits and challenges associated with this vision is also included.« less

Authors:
 [1];  [1];  [1];  [2];  [1];  [1];  [1];  [1];  [1];  [1];  [3]
  1. National Center for Atmospheric Research (NCAR), Boulder, CO (United States)
  2. Cooperative Institute for Research in Environmental Sciences (CIRES), Boulder, CO (United States)
  3. External contractor to National Center for Atmospheric Research (NCAR), Boulder, CO (United States)
Publication Date:
Research Org.:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States). National Energy Research Scientific Computing Center (NERSC); Univ. of California, Oakland, CA (United States); University Corporation for Atmospheric Research, Boulder, CO (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Biological and Environmental Research (BER)
OSTI Identifier:
1543483
Alternate Identifier(s):
OSTI ID: 1487157
Grant/Contract Number:  
AC02-05CH11231; FC02-97ER62402; DE‐AC02‐05CH11231
Resource Type:
Accepted Manuscript
Journal Name:
Quarterly Journal of the Royal Meteorological Society
Additional Journal Information:
Journal Volume: 144; Journal Issue: 717; Journal ID: ISSN 0035-9009
Publisher:
Royal Meteorological Society
Country of Publication:
United States
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES; meteorology & atmospheric sciences; Community Earth System Model; coupled data assimilation; coupled reanalysis; Data Assimilation Research Testbed; ensemble assimilation; ensemble Kalman filter; modular data assimilation

Citation Formats

Karspeck, Alicia R., Danabasoglu, Gokhan, Anderson, Jeffrey, Karol, Svetlana, Collins, Nancy, Vertenstein, Mariana, Raeder, Kevin, Hoar, Tim, Neale, Richard, Edwards, Jim, and Craig, Anthony. A global coupled ensemble data assimilation system using the Community Earth System Model and the Data Assimilation Research Testbed. United States: N. p., 2018. Web. doi:10.1002/qj.3308.
Karspeck, Alicia R., Danabasoglu, Gokhan, Anderson, Jeffrey, Karol, Svetlana, Collins, Nancy, Vertenstein, Mariana, Raeder, Kevin, Hoar, Tim, Neale, Richard, Edwards, Jim, & Craig, Anthony. A global coupled ensemble data assimilation system using the Community Earth System Model and the Data Assimilation Research Testbed. United States. https://doi.org/10.1002/qj.3308
Karspeck, Alicia R., Danabasoglu, Gokhan, Anderson, Jeffrey, Karol, Svetlana, Collins, Nancy, Vertenstein, Mariana, Raeder, Kevin, Hoar, Tim, Neale, Richard, Edwards, Jim, and Craig, Anthony. Mon . "A global coupled ensemble data assimilation system using the Community Earth System Model and the Data Assimilation Research Testbed". United States. https://doi.org/10.1002/qj.3308. https://www.osti.gov/servlets/purl/1543483.
@article{osti_1543483,
title = {A global coupled ensemble data assimilation system using the Community Earth System Model and the Data Assimilation Research Testbed},
author = {Karspeck, Alicia R. and Danabasoglu, Gokhan and Anderson, Jeffrey and Karol, Svetlana and Collins, Nancy and Vertenstein, Mariana and Raeder, Kevin and Hoar, Tim and Neale, Richard and Edwards, Jim and Craig, Anthony},
abstractNote = {This paper presents a description of the CESM/DART ensemble coupled data assimilation (DA) system based on the Community Earth System Model (CESM) and the Data Assimilation Research Testbed (DART) assimilation software. The CESM/DART should be viewed as a flexible system to support the DA needs of the CESM research community and not as a static reanalysis product. In this implementation of the CESM/DART, conventional insitu observations of the ocean and atmosphere are assimilated into the respective component models of the CESM using a 30‐member ensemble adjustment Kalman filter (EAKF). CESM/DART is run in a “weakly coupled” configuration wherein observations native to each climate system component only directly impact the state vector for that component. Information is passed between components indirectly through the short‐term coupled model forecasts that provide the EAKF background ensemble. This system leverages previous ensemble DA development for the Community Atmosphere Model and Parallel Ocean Program models using the DART EAKF. The CESM/DART project is a step towards providing increasingly useful DA capabilities for the CESM research community. Results are presented for our prototype 12‐year reanalysis, run from 1970 to mid 1982. Multiple lines of evidence demonstrate that the system is capable of constraining the CESM coupled model to simulate the historical variability of the climate system in the well‐observed Northern Hemisphere. A collection of monthly average variables, climate mode indices, observation diagnostics and snapshots of synoptic weather in the ocean and atmosphere are compared to established datasets, showing especially good agreement in the Northern Hemisphere. A discussion of the CESM/DART as a modular, community facility and the benefits and challenges associated with this vision is also included.},
doi = {10.1002/qj.3308},
journal = {Quarterly Journal of the Royal Meteorological Society},
number = 717,
volume = 144,
place = {United States},
year = {Mon Apr 16 00:00:00 EDT 2018},
month = {Mon Apr 16 00:00:00 EDT 2018}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 22 works
Citation information provided by
Web of Science

Figures / Tables:

Figure 1 Figure 1: Schematic diagram of the CESM coupled model in the multi-instance configuration. Each model component can have multiple instances, but a single coupler manages the communication of all fluxes between components.

Save / Share:

Works referenced in this record:

Ensemble-derived stationary and flow-dependent background-error covariances: Evaluation in a quasi-operational NWP setting
journal, April 2005

  • Buehner, Mark
  • Quarterly Journal of the Royal Meteorological Society, Vol. 131, Issue 607
  • DOI: 10.1256/qj.04.15

Improving Incremental Balance in the GSI 3DVAR Analysis System
journal, March 2009

  • Kleist, Daryl T.; Parrish, David F.; Derber, John C.
  • Monthly Weather Review, Vol. 137, Issue 3
  • DOI: 10.1175/2008MWR2623.1

The Hybrid Local Ensemble Transform Kalman Filter
journal, June 2014


The CCSM4 Ocean Component
journal, March 2012

  • Danabasoglu, Gokhan; Bates, Susan C.; Briegleb, Bruce P.
  • Journal of Climate, Vol. 25, Issue 5
  • DOI: 10.1175/JCLI-D-11-00091.1

Coupled Data Assimilation for Integrated Earth System Analysis and Prediction
journal, July 2017

  • Penny, Stephen G.; Hamill, Thomas M.
  • Bulletin of the American Meteorological Society, Vol. 98, Issue 7
  • DOI: 10.1175/BAMS-D-17-0036.1

Distance-Dependent Filtering of Background Error Covariance Estimates in an Ensemble Kalman Filter
journal, November 2001


Decadal Climate Prediction: An Update from the Trenches
journal, February 2014

  • Meehl, Gerald A.; Goddard, Lisa; Boer, George
  • Bulletin of the American Meteorological Society, Vol. 95, Issue 2
  • DOI: 10.1175/BAMS-D-12-00241.1

Assimilation of MODIS snow cover through the Data Assimilation Research Testbed and the Community Land Model version 4: SNOW DATA ASSIMILATION
journal, June 2014

  • Zhang, Yong-Fei; Hoar, Tim J.; Yang, Zong-Liang
  • Journal of Geophysical Research: Atmospheres, Vol. 119, Issue 12
  • DOI: 10.1002/2013JD021329

Adaptive Sampling with the Ensemble Transform Kalman Filter. Part I: Theoretical Aspects
journal, March 2001


The Gales of 2 January 1976
journal, June 1976


Software for ensemble-based data assimilation systems—Implementation strategies and scalability
journal, June 2013


Upper Ocean Response to a Hurricane
journal, February 1981


An Overview of CMIP5 and the Experiment Design
journal, April 2012

  • Taylor, Karl E.; Stouffer, Ronald J.; Meehl, Gerald A.
  • Bulletin of the American Meteorological Society, Vol. 93, Issue 4
  • DOI: 10.1175/BAMS-D-11-00094.1

Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation
journal, December 2016


Construction of correlation functions in two and three dimensions
journal, January 1999

  • Gaspari, Gregory; Cohn, Stephen E.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 125, Issue 554
  • DOI: 10.1002/qj.49712555417

Improved Sea Ice Shortwave Radiation Physics in CCSM4: The Impact of Melt Ponds and Aerosols on Arctic Sea Ice
journal, March 2012

  • Holland, Marika M.; Bailey, David A.; Briegleb, Bruce P.
  • Journal of Climate, Vol. 25, Issue 5
  • DOI: 10.1175/JCLI-D-11-00078.1

A Hybrid Ensemble Kalman Filter–3D Variational Analysis Scheme
journal, August 2000


Daily High-Resolution-Blended Analyses for Sea Surface Temperature
journal, November 2007

  • Reynolds, Richard W.; Smith, Thomas M.; Liu, Chunying
  • Journal of Climate, Vol. 20, Issue 22
  • DOI: 10.1175/2007JCLI1824.1

A New Globally Complete Monthly Historical Gridded Mean Sea Level Pressure Dataset (HadSLP2): 1850–2004
journal, November 2006


The Bluelink ocean data assimilation system (BODAS)
journal, January 2008


The 10,240-member ensemble Kalman filtering with an intermediate AGCM: 10240-MEMBER ENKF WITH AN AGCM
journal, July 2014

  • Miyoshi, Takemasa; Kondo, Keiichi; Imamura, Toshiyuki
  • Geophysical Research Letters, Vol. 41, Issue 14
  • DOI: 10.1002/2014GL060863

A Local Least Squares Framework for Ensemble Filtering
journal, April 2003


A coupled data assimilation system for climate reanalysis: Coupled Data Assimilation for Climate Reanalysis
journal, September 2015

  • Laloyaux, Patrick; Balmaseda, Magdalena; Dee, Dick
  • Quarterly Journal of the Royal Meteorological Society, Vol. 142, Issue 694
  • DOI: 10.1002/qj.2629

The Community Earth System Model (CESM) Large Ensemble Project: A Community Resource for Studying Climate Change in the Presence of Internal Climate Variability
journal, August 2015

  • Kay, J. E.; Deser, C.; Phillips, A.
  • Bulletin of the American Meteorological Society, Vol. 96, Issue 8
  • DOI: 10.1175/BAMS-D-13-00255.1

Data assimilation in weather forecasting: a case study in PDE-constrained optimization
journal, July 2008

  • Fisher, Mike; Nocedal, Jorge; Trémolet, Yannick
  • Optimization and Engineering, Vol. 10, Issue 3
  • DOI: 10.1007/s11081-008-9051-5

Ensemble Square Root Filters*
journal, July 2003


Ensemble Optimal Interpolation: multivariate properties in the Gulf of Mexico
journal, January 2009


Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter variants
journal, February 2007


Limited-memory preconditioners, with application to incremental four-dimensional variational data assimilation
journal, January 2008

  • Tshimanga, J.; Gratton, S.; Weaver, A. T.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 134, Issue 632
  • DOI: 10.1002/qj.228

An Ensemble Adjustment Kalman Filter for Data Assimilation
journal, December 2001


The Mean Climate of the Community Atmosphere Model (CAM4) in Forced SST and Fully Coupled Experiments
journal, July 2013


NCEP–DOE AMIP-II Reanalysis (R-2)
journal, November 2002

  • Kanamitsu, Masao; Ebisuzaki, Wesley; Woollen, Jack
  • Bulletin of the American Meteorological Society, Vol. 83, Issue 11
  • DOI: 10.1175/BAMS-83-11-1631

An Ensemble Adjustment Kalman Filter for the CCSM4 Ocean Component
journal, October 2013

  • Karspeck, Alicia R.; Yeager, Steve; Danabasoglu, Gokhan
  • Journal of Climate, Vol. 26, Issue 19
  • DOI: 10.1175/JCLI-D-12-00402.1

Ocean Initialization for Seasonal Forecasts
journal, September 2009


The Community Earth System Model: A Framework for Collaborative Research
journal, September 2013

  • Hurrell, James W.; Holland, M. M.; Gent, P. R.
  • Bulletin of the American Meteorological Society, Vol. 94, Issue 9
  • DOI: 10.1175/BAMS-D-12-00121.1

Evaluating Methods to Account for System Errors in Ensemble Data Assimilation
journal, September 2012


Assessing a New Coupled Data Assimilation System Based on the Met Office Coupled Atmosphere–Land–Ocean–Sea Ice Model
journal, November 2015


Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics
journal, January 1994

  • Evensen, Geir
  • Journal of Geophysical Research, Vol. 99, Issue C5
  • DOI: 10.1029/94JC00572

Assimilating atmospheric observations into the ocean using strongly coupled ensemble data assimilation
journal, January 2016

  • Sluka, Travis C.; Penny, Stephen G.; Kalnay, Eugenia
  • Geophysical Research Letters, Vol. 43, Issue 2
  • DOI: 10.1002/2015GL067238

The ERA-40 re-analysis
journal, October 2005

  • Uppala, S. M.; KÅllberg, P. W.; Simmons, A. J.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 131, Issue 612
  • DOI: 10.1256/qj.04.176

Atlantic Hurricane Season of 1980
journal, July 1981


The evolution of the ECMWF hybrid data assimilation system: Evolution of ECMWF Hybrid Data Assimilation
journal, September 2015

  • Bonavita, Massimo; Hólm, Elias; Isaksen, Lars
  • Quarterly Journal of the Royal Meteorological Society, Vol. 142, Issue 694
  • DOI: 10.1002/qj.2652

An assessment of oceanic variability for 1960–2010 from the GFDL ensemble coupled data assimilation
journal, June 2012


Reassessing biases and other uncertainties in sea surface temperature observations measured in situ since 1850: 2. Biases and homogenization
journal, January 2011

  • Kennedy, J. J.; Rayner, N. A.; Smith, R. O.
  • Journal of Geophysical Research, Vol. 116, Issue D14
  • DOI: 10.1029/2010JD015220

Multi-model seasonal forecast of Arctic sea-ice: forecast uncertainty at pan-Arctic and regional scales
journal, October 2016

  • Blanchard-Wrigglesworth, E.; Barthélemy, A.; Chevallier, M.
  • Climate Dynamics, Vol. 49, Issue 4
  • DOI: 10.1007/s00382-016-3388-9

A Decadal Prediction Case Study: Late Twentieth-Century North Atlantic Ocean Heat Content
journal, August 2012

  • Yeager, Stephen; Karspeck, Alicia; Danabasoglu, Gokhan
  • Journal of Climate, Vol. 25, Issue 15
  • DOI: 10.1175/JCLI-D-11-00595.1

Scalable Implementations of Ensemble Filter Algorithms for Data Assimilation
journal, August 2007

  • Anderson, Jeffrey L.; Collins, Nancy
  • Journal of Atmospheric and Oceanic Technology, Vol. 24, Issue 8
  • DOI: 10.1175/JTECH2049.1

The North American Multimodel Ensemble: Phase-1 Seasonal-to-Interannual Prediction; Phase-2 toward Developing Intraseasonal Prediction
journal, April 2014

  • Kirtman, Ben P.; Min, Dughong; Infanti, Johnna M.
  • Bulletin of the American Meteorological Society, Vol. 95, Issue 4
  • DOI: 10.1175/BAMS-D-12-00050.1

Experimental Tropical Cyclone Forecasts Using a Variable-Resolution Global Model
journal, October 2015

  • Zarzycki, Colin M.; Jablonowski, Christiane
  • Monthly Weather Review, Vol. 143, Issue 10
  • DOI: 10.1175/MWR-D-15-0159.1

The Twentieth Century Reanalysis Project
journal, January 2011

  • Compo, G. P.; Whitaker, J. S.; Sardeshmukh, P. D.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 137, Issue 654
  • DOI: 10.1002/qj.776

A Global Oceanic Data Assimilation System
journal, September 1989


DART/CAM: An Ensemble Data Assimilation System for CESM Atmospheric Models
journal, September 2012


The Data Assimilation Research Testbed: A Community Facility
journal, September 2009

  • Anderson, Jeffrey; Hoar, Tim; Raeder, Kevin
  • Bulletin of the American Meteorological Society, Vol. 90, Issue 9
  • DOI: 10.1175/2009BAMS2618.1

The NCEP–NCAR 50–Year Reanalysis: Monthly Means CD–ROM and Documentation
journal, February 2001


An Adaptive Ensemble Kalman Filter
journal, January 2000


Global analyses of sea surface temperature, sea ice, and night marine air temperature since the late nineteenth century
journal, January 2003


An evaluation of experimental decadal predictions using CCSM4
journal, July 2014


The NCEP Climate Forecast System Reanalysis
journal, August 2010

  • Saha, Suranjana; Moorthi, Shrinivas; Pan, Hua-Lu
  • Bulletin of the American Meteorological Society, Vol. 91, Issue 8
  • DOI: 10.1175/2010BAMS3001.1

ICOADS Release 2.5: extensions and enhancements to the surface marine meteorological archive
journal, March 2010

  • Woodruff, Scott D.; Worley, Steven J.; Lubker, Sandra J.
  • International Journal of Climatology, Vol. 31, Issue 7
  • DOI: 10.1002/joc.2103

Updated high-resolution grids of monthly climatic observations - the CRU TS3.10 Dataset: UPDATED HIGH-RESOLUTION GRIDS OF MONTHLY CLIMATIC OBSERVATIONS
journal, May 2013

  • Harris, I.; Jones, P. D.; Osborn, T. J.
  • International Journal of Climatology, Vol. 34, Issue 3
  • DOI: 10.1002/joc.3711

The new eddy-permitting ORAP5 ocean reanalysis: description, evaluation and uncertainties in climate signals
journal, June 2015


The NCEP/NCAR 40-Year Reanalysis Project
journal, March 1996


Parameterization improvements and functional and structural advances in Version 4 of the Community Land Model
journal, January 2011

  • Lawrence, David M.; Oleson, Keith W.; Flanner, Mark G.
  • Journal of Advances in Modeling Earth Systems, Vol. 3, Issue 3
  • DOI: 10.1029/2011MS000045

Origin and Impact of Initialization Shocks in Coupled Atmosphere–Ocean Forecasts*
journal, November 2015

  • Mulholland, David P.; Laloyaux, Patrick; Haines, Keith
  • Monthly Weather Review, Vol. 143, Issue 11
  • DOI: 10.1175/MWR-D-15-0076.1

The JRA-55 Reanalysis: General Specifications and Basic Characteristics
journal, January 2015

  • Kobayashi, Shinya; Ota, Yukinari; Harada, Yayoi
  • Journal of the Meteorological Society of Japan. Ser. II, Vol. 93, Issue 1
  • DOI: 10.2151/jmsj.2015-001

Assimilation of surface velocity data into a primitive equation coastal ocean model
journal, January 2002


System Design and Evaluation of Coupled Ensemble Data Assimilation for Global Oceanic Climate Studies
journal, October 2007

  • Zhang, S.; Harrison, M. J.; Rosati, A.
  • Monthly Weather Review, Vol. 135, Issue 10
  • DOI: 10.1175/MWR3466.1

A flexible I/O arbitration framework for netCDF-based big data processing workflows on high-end supercomputers: A Flexible I/O Arbitration Framework for netCDF based Big Data Processing
journal, May 2017

  • Liao, Jianwei; Gerofi, Balazs; Lien, Guo-Yuan
  • Concurrency and Computation: Practice and Experience, Vol. 29, Issue 15
  • DOI: 10.1002/cpe.4161

Spatially and temporally varying adaptive covariance inflation for ensemble filters
journal, January 2009


EN4: Quality controlled ocean temperature and salinity profiles and monthly objective analyses with uncertainty estimates: THE EN4 DATA SET
journal, December 2013

  • Good, Simon A.; Martin, Matthew J.; Rayner, Nick A.
  • Journal of Geophysical Research: Oceans, Vol. 118, Issue 12
  • DOI: 10.1002/2013JC009067

Works referencing / citing this record:

Impact of Snow Initialization in Subseasonal‐to‐Seasonal Winter Forecasts With the Norwegian Climate Prediction Model
journal, September 2019

  • Li, F.; Orsolini, Y. J.; Keenlyside, N.
  • Journal of Geophysical Research: Atmospheres, Vol. 124, Issue 17-18
  • DOI: 10.1029/2019jd030903

Tropical climate variability in the Community Earth System Model: Data Assimilation Research Testbed
journal, December 2019

  • Eliashiv, Jonathan; Subramanian, Aneesh C.; Miller, Arthur J.
  • Climate Dynamics, Vol. 54, Issue 1-2
  • DOI: 10.1007/s00382-019-05030-6