A global coupled ensemble data assimilation system using the Community Earth System Model and the Data Assimilation Research Testbed
Abstract
In this paper, we present a description of the CESM/DART ensemble coupled data assimilation (DA) system based on the Community Earth System Model (CESM) and the Data Assimilation Research Testbed (DART) assimilation software. The CESM/DART should be viewed as a flexible system to support the DA needs of the CESM research community and not as a static reanalysis product. In this implementation of the CESM/DART, conventional insitu observations of the ocean and atmosphere are assimilated into the respective component models of the CESM using a 30-member ensemble adjustment Kalman filter (EAKF). CESM/DART is run in a “weakly coupled” configuration wherein observations native to each climate system component only directly impact the state vector for that component. Information is passed between components indirectly through the short-term coupled model forecasts that provide the EAKF background ensemble. This system leverages previous ensemble DA development for the Community Atmosphere Model and Parallel Ocean Program models using the DART EAKF. The CESM/DART project is a step towards providing increasingly useful DA capabilities for the CESM research community. Results are presented for our prototype 12-year reanalysis, run from 1970 to mid 1982. Multiple lines of evidence demonstrate that the system is capable of constraining the CESMmore »
- Authors:
-
- National Center for Atmospheric Research (NCAR), Boulder, CO (United States)
- Cooperative Institute for Research in Environmental Sciences (CIRES), Boulder, CO (United States)
- External contractor to National Center for Atmospheric Research (NCAR), Boulder, CO (United States)
- Publication Date:
- Research Org.:
- Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). National Energy Research Scientific Computing Center (NERSC); Univ. of California, Oakland, CA (United States); University Corporation for Atmospheric Research, Boulder, CO (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Biological and Environmental Research (BER)
- OSTI Identifier:
- 1543483
- Alternate Identifier(s):
- OSTI ID: 1487157
- Grant/Contract Number:
- AC02-05CH11231; FC02-97ER62402; DE‐AC02‐05CH11231
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Quarterly Journal of the Royal Meteorological Society
- Additional Journal Information:
- Journal Volume: 144; Journal Issue: 717; Journal ID: ISSN 0035-9009
- Publisher:
- Royal Meteorological Society
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 54 ENVIRONMENTAL SCIENCES; meteorology & atmospheric sciences; Community Earth System Model; coupled data assimilation; coupled reanalysis; Data Assimilation Research Testbed; ensemble assimilation; ensemble Kalman filter; modular data assimilation
Citation Formats
Karspeck, Alicia R., Danabasoglu, Gokhan, Anderson, Jeffrey, Karol, Svetlana, Collins, Nancy, Vertenstein, Mariana, Raeder, Kevin, Hoar, Tim, Neale, Richard, Edwards, Jim, and Craig, Anthony. A global coupled ensemble data assimilation system using the Community Earth System Model and the Data Assimilation Research Testbed. United States: N. p., 2018.
Web. doi:10.1002/qj.3308.
Karspeck, Alicia R., Danabasoglu, Gokhan, Anderson, Jeffrey, Karol, Svetlana, Collins, Nancy, Vertenstein, Mariana, Raeder, Kevin, Hoar, Tim, Neale, Richard, Edwards, Jim, & Craig, Anthony. A global coupled ensemble data assimilation system using the Community Earth System Model and the Data Assimilation Research Testbed. United States. https://doi.org/10.1002/qj.3308
Karspeck, Alicia R., Danabasoglu, Gokhan, Anderson, Jeffrey, Karol, Svetlana, Collins, Nancy, Vertenstein, Mariana, Raeder, Kevin, Hoar, Tim, Neale, Richard, Edwards, Jim, and Craig, Anthony. Mon .
"A global coupled ensemble data assimilation system using the Community Earth System Model and the Data Assimilation Research Testbed". United States. https://doi.org/10.1002/qj.3308. https://www.osti.gov/servlets/purl/1543483.
@article{osti_1543483,
title = {A global coupled ensemble data assimilation system using the Community Earth System Model and the Data Assimilation Research Testbed},
author = {Karspeck, Alicia R. and Danabasoglu, Gokhan and Anderson, Jeffrey and Karol, Svetlana and Collins, Nancy and Vertenstein, Mariana and Raeder, Kevin and Hoar, Tim and Neale, Richard and Edwards, Jim and Craig, Anthony},
abstractNote = {In this paper, we present a description of the CESM/DART ensemble coupled data assimilation (DA) system based on the Community Earth System Model (CESM) and the Data Assimilation Research Testbed (DART) assimilation software. The CESM/DART should be viewed as a flexible system to support the DA needs of the CESM research community and not as a static reanalysis product. In this implementation of the CESM/DART, conventional insitu observations of the ocean and atmosphere are assimilated into the respective component models of the CESM using a 30-member ensemble adjustment Kalman filter (EAKF). CESM/DART is run in a “weakly coupled” configuration wherein observations native to each climate system component only directly impact the state vector for that component. Information is passed between components indirectly through the short-term coupled model forecasts that provide the EAKF background ensemble. This system leverages previous ensemble DA development for the Community Atmosphere Model and Parallel Ocean Program models using the DART EAKF. The CESM/DART project is a step towards providing increasingly useful DA capabilities for the CESM research community. Results are presented for our prototype 12-year reanalysis, run from 1970 to mid 1982. Multiple lines of evidence demonstrate that the system is capable of constraining the CESM coupled model to simulate the historical variability of the climate system in the well-observed Northern Hemisphere. A collection of monthly average variables, climate mode indices, observation diagnostics and snapshots of synoptic weather in the ocean and atmosphere are compared to established datasets, showing especially good agreement in the Northern Hemisphere. A discussion of the CESM/DART as a modular, community facility and the benefits and challenges associated with this vision is also included.},
doi = {10.1002/qj.3308},
journal = {Quarterly Journal of the Royal Meteorological Society},
number = 717,
volume = 144,
place = {United States},
year = {2018},
month = {4}
}
Web of Science
Figures / Tables:

Works referenced in this record:
Ensemble-derived stationary and flow-dependent background-error covariances: Evaluation in a quasi-operational NWP setting
journal, April 2005
- Buehner, Mark
- Quarterly Journal of the Royal Meteorological Society, Vol. 131, Issue 607
Improving Incremental Balance in the GSI 3DVAR Analysis System
journal, March 2009
- Kleist, Daryl T.; Parrish, David F.; Derber, John C.
- Monthly Weather Review, Vol. 137, Issue 3
The Hybrid Local Ensemble Transform Kalman Filter
journal, June 2014
- Penny, Stephen G.
- Monthly Weather Review, Vol. 142, Issue 6
The CCSM4 Ocean Component
journal, March 2012
- Danabasoglu, Gokhan; Bates, Susan C.; Briegleb, Bruce P.
- Journal of Climate, Vol. 25, Issue 5
Coupled Data Assimilation for Integrated Earth System Analysis and Prediction
journal, July 2017
- Penny, Stephen G.; Hamill, Thomas M.
- Bulletin of the American Meteorological Society, Vol. 98, Issue 7
A reformulation of the background error covariance in the ECMWF global data assimilation system
journal, March 1999
- Derber, J.; Bouttier, F.
- Tellus A, Vol. 51, Issue 2
Distance-Dependent Filtering of Background Error Covariance Estimates in an Ensemble Kalman Filter
journal, November 2001
- Hamill, Thomas M.; Whitaker, Jeffrey S.; Snyder, Chris
- Monthly Weather Review, Vol. 129, Issue 11
Decadal Climate Prediction: An Update from the Trenches
journal, February 2014
- Meehl, Gerald A.; Goddard, Lisa; Boer, George
- Bulletin of the American Meteorological Society, Vol. 95, Issue 2
Assimilation of MODIS snow cover through the Data Assimilation Research Testbed and the Community Land Model version 4: SNOW DATA ASSIMILATION
journal, June 2014
- Zhang, Yong-Fei; Hoar, Tim J.; Yang, Zong-Liang
- Journal of Geophysical Research: Atmospheres, Vol. 119, Issue 12
Adaptive Sampling with the Ensemble Transform Kalman Filter. Part I: Theoretical Aspects
journal, March 2001
- Bishop, Craig H.; Etherton, Brian J.; Majumdar, Sharanya J.
- Monthly Weather Review, Vol. 129, Issue 3
The Gales of 2 January 1976
journal, June 1976
- Shaw, M. S.; Hopkins, J. S.; Caton, P. G. F.
- Weather, Vol. 31, Issue 6
Software for ensemble-based data assimilation systems—Implementation strategies and scalability
journal, June 2013
- Nerger, Lars; Hiller, Wolfgang
- Computers & Geosciences, Vol. 55
Upper Ocean Response to a Hurricane
journal, February 1981
- Price, James F.
- Journal of Physical Oceanography, Vol. 11, Issue 2
An Overview of CMIP5 and the Experiment Design
journal, April 2012
- Taylor, Karl E.; Stouffer, Ronald J.; Meehl, Gerald A.
- Bulletin of the American Meteorological Society, Vol. 93, Issue 4
A Study of Impacts of Coupled Model Initial Shocks and State–Parameter Optimization on Climate Predictions Using a Simple Pycnocline Prediction Model
journal, December 2011
- Zhang, S.
- Journal of Climate, Vol. 24, Issue 23
Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation
journal, December 2016
- Houtekamer, P. L.; Zhang, Fuqing
- Monthly Weather Review, Vol. 144, Issue 12
Construction of correlation functions in two and three dimensions
journal, January 1999
- Gaspari, Gregory; Cohn, Stephen E.
- Quarterly Journal of the Royal Meteorological Society, Vol. 125, Issue 554
Improved Sea Ice Shortwave Radiation Physics in CCSM4: The Impact of Melt Ponds and Aerosols on Arctic Sea Ice
journal, March 2012
- Holland, Marika M.; Bailey, David A.; Briegleb, Bruce P.
- Journal of Climate, Vol. 25, Issue 5
A Hybrid Ensemble Kalman Filter–3D Variational Analysis Scheme
journal, August 2000
- Hamill, Thomas M.; Snyder, Chris
- Monthly Weather Review, Vol. 128, Issue 8
Daily High-Resolution-Blended Analyses for Sea Surface Temperature
journal, November 2007
- Reynolds, Richard W.; Smith, Thomas M.; Liu, Chunying
- Journal of Climate, Vol. 20, Issue 22
A New Globally Complete Monthly Historical Gridded Mean Sea Level Pressure Dataset (HadSLP2): 1850–2004
journal, November 2006
- Allan, Rob; Ansell, Tara
- Journal of Climate, Vol. 19, Issue 22
The Bluelink ocean data assimilation system (BODAS)
journal, January 2008
- Oke, Peter R.; Brassington, Gary B.; Griffin, David A.
- Ocean Modelling, Vol. 21, Issue 1-2
The 10,240-member ensemble Kalman filtering with an intermediate AGCM: 10240-MEMBER ENKF WITH AN AGCM
journal, July 2014
- Miyoshi, Takemasa; Kondo, Keiichi; Imamura, Toshiyuki
- Geophysical Research Letters, Vol. 41, Issue 14
A Local Least Squares Framework for Ensemble Filtering
journal, April 2003
- Anderson, Jeffrey L.
- Monthly Weather Review, Vol. 131, Issue 4
Effects of ocean grid resolution on tropical cyclone-induced upper ocean responses using a global ocean general circulation model: RESOLUTION AFFECTS OCEAN RESPONSE TO TC
journal, November 2016
- Li, Hui; Sriver, Ryan L.
- Journal of Geophysical Research: Oceans, Vol. 121, Issue 11
A coupled data assimilation system for climate reanalysis: Coupled Data Assimilation for Climate Reanalysis
journal, September 2015
- Laloyaux, Patrick; Balmaseda, Magdalena; Dee, Dick
- Quarterly Journal of the Royal Meteorological Society, Vol. 142, Issue 694
The Community Earth System Model (CESM) Large Ensemble Project: A Community Resource for Studying Climate Change in the Presence of Internal Climate Variability
journal, August 2015
- Kay, J. E.; Deser, C.; Phillips, A.
- Bulletin of the American Meteorological Society, Vol. 96, Issue 8
Data assimilation in weather forecasting: a case study in PDE-constrained optimization
journal, July 2008
- Fisher, Mike; Nocedal, Jorge; Trémolet, Yannick
- Optimization and Engineering, Vol. 10, Issue 3
Ensemble Square Root Filters*
journal, July 2003
- Tippett, Michael K.; Anderson, Jeffrey L.; Bishop, Craig H.
- Monthly Weather Review, Vol. 131, Issue 7
Ensemble Optimal Interpolation: multivariate properties in the Gulf of Mexico
journal, January 2009
- Counillon, Francçois; Bertino, Laurent
- Tellus A: Dynamic Meteorology and Oceanography, Vol. 61, Issue 2
Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter variants
journal, February 2007
- Furrer, Reinhard; Bengtsson, Thomas
- Journal of Multivariate Analysis, Vol. 98, Issue 2
Limited-memory preconditioners, with application to incremental four-dimensional variational data assimilation
journal, January 2008
- Tshimanga, J.; Gratton, S.; Weaver, A. T.
- Quarterly Journal of the Royal Meteorological Society, Vol. 134, Issue 632
An Ensemble Adjustment Kalman Filter for Data Assimilation
journal, December 2001
- Anderson, Jeffrey L.
- Monthly Weather Review, Vol. 129, Issue 12
An Ensemble Approach for the Estimation of Observational Error Illustrated for a Nominal 1° Global Ocean Model
journal, May 2016
- Karspeck, Alicia R.
- Monthly Weather Review, Vol. 144, Issue 5
The Mean Climate of the Community Atmosphere Model (CAM4) in Forced SST and Fully Coupled Experiments
journal, July 2013
- Neale, Richard B.; Richter, Jadwiga; Park, Sungsu
- Journal of Climate, Vol. 26, Issue 14
NCEP–DOE AMIP-II Reanalysis (R-2)
journal, November 2002
- Kanamitsu, Masao; Ebisuzaki, Wesley; Woollen, Jack
- Bulletin of the American Meteorological Society, Vol. 83, Issue 11
An Ensemble Adjustment Kalman Filter for the CCSM4 Ocean Component
journal, October 2013
- Karspeck, Alicia R.; Yeager, Steve; Danabasoglu, Gokhan
- Journal of Climate, Vol. 26, Issue 19
Ocean Initialization for Seasonal Forecasts
journal, September 2009
- Balmaseda, Magdalena; Alves, Oscar; Arribas, Alberto
- Oceanography, Vol. 22, Issue 3
The Community Earth System Model: A Framework for Collaborative Research
journal, September 2013
- Hurrell, James W.; Holland, M. M.; Gent, P. R.
- Bulletin of the American Meteorological Society, Vol. 94, Issue 9
Evaluating Methods to Account for System Errors in Ensemble Data Assimilation
journal, September 2012
- Whitaker, Jeffrey S.; Hamill, Thomas M.
- Monthly Weather Review, Vol. 140, Issue 9
Assessing a New Coupled Data Assimilation System Based on the Met Office Coupled Atmosphere–Land–Ocean–Sea Ice Model
journal, November 2015
- Lea, D. J.; Mirouze, I.; Martin, M. J.
- Monthly Weather Review, Vol. 143, Issue 11
Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics
journal, January 1994
- Evensen, Geir
- Journal of Geophysical Research, Vol. 99, Issue C5
Assimilating atmospheric observations into the ocean using strongly coupled ensemble data assimilation
journal, January 2016
- Sluka, Travis C.; Penny, Stephen G.; Kalnay, Eugenia
- Geophysical Research Letters, Vol. 43, Issue 2
The ERA-40 re-analysis
journal, October 2005
- Uppala, S. M.; KÅllberg, P. W.; Simmons, A. J.
- Quarterly Journal of the Royal Meteorological Society, Vol. 131, Issue 612
Atlantic Hurricane Season of 1980
journal, July 1981
- Lawrence, Miles B.; Pelissier, Joseph M.
- Monthly Weather Review, Vol. 109, Issue 7
The evolution of the ECMWF hybrid data assimilation system: Evolution of ECMWF Hybrid Data Assimilation
journal, September 2015
- Bonavita, Massimo; Hólm, Elias; Isaksen, Lars
- Quarterly Journal of the Royal Meteorological Society, Vol. 142, Issue 694
An assessment of oceanic variability for 1960–2010 from the GFDL ensemble coupled data assimilation
journal, June 2012
- Chang, You-Soon; Zhang, Shaoqing; Rosati, Anthony
- Climate Dynamics, Vol. 40, Issue 3-4
Reassessing biases and other uncertainties in sea surface temperature observations measured in situ since 1850: 2. Biases and homogenization
journal, January 2011
- Kennedy, J. J.; Rayner, N. A.; Smith, R. O.
- Journal of Geophysical Research, Vol. 116, Issue D14
Multi-model seasonal forecast of Arctic sea-ice: forecast uncertainty at pan-Arctic and regional scales
journal, October 2016
- Blanchard-Wrigglesworth, E.; Barthélemy, A.; Chevallier, M.
- Climate Dynamics, Vol. 49, Issue 4
A Decadal Prediction Case Study: Late Twentieth-Century North Atlantic Ocean Heat Content
journal, August 2012
- Yeager, Stephen; Karspeck, Alicia; Danabasoglu, Gokhan
- Journal of Climate, Vol. 25, Issue 15
Scalable Implementations of Ensemble Filter Algorithms for Data Assimilation
journal, August 2007
- Anderson, Jeffrey L.; Collins, Nancy
- Journal of Atmospheric and Oceanic Technology, Vol. 24, Issue 8
The North American Multimodel Ensemble: Phase-1 Seasonal-to-Interannual Prediction; Phase-2 toward Developing Intraseasonal Prediction
journal, April 2014
- Kirtman, Ben P.; Min, Dughong; Infanti, Johnna M.
- Bulletin of the American Meteorological Society, Vol. 95, Issue 4
Experimental Tropical Cyclone Forecasts Using a Variable-Resolution Global Model
journal, October 2015
- Zarzycki, Colin M.; Jablonowski, Christiane
- Monthly Weather Review, Vol. 143, Issue 10
The Twentieth Century Reanalysis Project
journal, January 2011
- Compo, G. P.; Whitaker, J. S.; Sardeshmukh, P. D.
- Quarterly Journal of the Royal Meteorological Society, Vol. 137, Issue 654
An Improved Coupled Model for ENSO Prediction and Implications for Ocean Initialization. Part I: The Ocean Data Assimilation System
journal, April 1998
- Behringer, David W.; Ji, Ming; Leetmaa, Ants
- Monthly Weather Review, Vol. 126, Issue 4
A Global Oceanic Data Assimilation System
journal, September 1989
- Derber, John; Rosati, Anthony
- Journal of Physical Oceanography, Vol. 19, Issue 9
DART/CAM: An Ensemble Data Assimilation System for CESM Atmospheric Models
journal, September 2012
- Raeder, Kevin; Anderson, Jeffrey L.; Collins, Nancy
- Journal of Climate, Vol. 25, Issue 18
The Data Assimilation Research Testbed: A Community Facility
journal, September 2009
- Anderson, Jeffrey; Hoar, Tim; Raeder, Kevin
- Bulletin of the American Meteorological Society, Vol. 90, Issue 9
The NCEP–NCAR 50–Year Reanalysis: Monthly Means CD–ROM and Documentation
journal, February 2001
- Kistler, Robert; Collins, William; Saha, Suranjana
- Bulletin of the American Meteorological Society, Vol. 82, Issue 2
An Adaptive Ensemble Kalman Filter
journal, January 2000
- Mitchell, Herschel L.; Houtekamer, P. L.
- Monthly Weather Review, Vol. 128, Issue 2
Global analyses of sea surface temperature, sea ice, and night marine air temperature since the late nineteenth century
journal, January 2003
- Rayner, N. A.
- Journal of Geophysical Research, Vol. 108, Issue D14
An evaluation of experimental decadal predictions using CCSM4
journal, July 2014
- Karspeck, A.; Yeager, S.; Danabasoglu, G.
- Climate Dynamics, Vol. 44, Issue 3-4
The NCEP Climate Forecast System Reanalysis
journal, August 2010
- Saha, Suranjana; Moorthi, Shrinivas; Pan, Hua-Lu
- Bulletin of the American Meteorological Society, Vol. 91, Issue 8
ICOADS Release 2.5: extensions and enhancements to the surface marine meteorological archive
journal, March 2010
- Woodruff, Scott D.; Worley, Steven J.; Lubker, Sandra J.
- International Journal of Climatology, Vol. 31, Issue 7
Updated high-resolution grids of monthly climatic observations - the CRU TS3.10 Dataset: UPDATED HIGH-RESOLUTION GRIDS OF MONTHLY CLIMATIC OBSERVATIONS
journal, May 2013
- Harris, I.; Jones, P. D.; Osborn, T. J.
- International Journal of Climatology, Vol. 34, Issue 3
The new eddy-permitting ORAP5 ocean reanalysis: description, evaluation and uncertainties in climate signals
journal, June 2015
- Zuo, Hao; Balmaseda, Magdalena A.; Mogensen, Kristian
- Climate Dynamics, Vol. 49, Issue 3
The NCEP/NCAR 40-Year Reanalysis Project
journal, March 1996
- Kalnay, E.; Kanamitsu, M.; Kistler, R.
- Bulletin of the American Meteorological Society, Vol. 77, Issue 3
Parameterization improvements and functional and structural advances in Version 4 of the Community Land Model
journal, January 2011
- Lawrence, David M.; Oleson, Keith W.; Flanner, Mark G.
- Journal of Advances in Modeling Earth Systems, Vol. 3, Issue 3
Origin and Impact of Initialization Shocks in Coupled Atmosphere–Ocean Forecasts*
journal, November 2015
- Mulholland, David P.; Laloyaux, Patrick; Haines, Keith
- Monthly Weather Review, Vol. 143, Issue 11
The JRA-55 Reanalysis: General Specifications and Basic Characteristics
journal, January 2015
- Kobayashi, Shinya; Ota, Yukinari; Harada, Yayoi
- Journal of the Meteorological Society of Japan. Ser. II, Vol. 93, Issue 1
Assimilation of surface velocity data into a primitive equation coastal ocean model
journal, January 2002
- Oke, Peter R.
- Journal of Geophysical Research, Vol. 107, Issue C9
System Design and Evaluation of Coupled Ensemble Data Assimilation for Global Oceanic Climate Studies
journal, October 2007
- Zhang, S.; Harrison, M. J.; Rosati, A.
- Monthly Weather Review, Vol. 135, Issue 10
A flexible I/O arbitration framework for netCDF-based big data processing workflows on high-end supercomputers: A Flexible I/O Arbitration Framework for netCDF based Big Data Processing
journal, May 2017
- Liao, Jianwei; Gerofi, Balazs; Lien, Guo-Yuan
- Concurrency and Computation: Practice and Experience, Vol. 29, Issue 15
Spatially and temporally varying adaptive covariance inflation for ensemble filters
journal, January 2009
- Anderson, Jeffrey L.
- Tellus A, Vol. 61, Issue 1
EN4: Quality controlled ocean temperature and salinity profiles and monthly objective analyses with uncertainty estimates: THE EN4 DATA SET
journal, December 2013
- Good, Simon A.; Martin, Matthew J.; Rayner, Nick A.
- Journal of Geophysical Research: Oceans, Vol. 118, Issue 12
Works referencing / citing this record:
Impact of Snow Initialization in Subseasonal‐to‐Seasonal Winter Forecasts With the Norwegian Climate Prediction Model
journal, September 2019
- Li, F.; Orsolini, Y. J.; Keenlyside, N.
- Journal of Geophysical Research: Atmospheres, Vol. 124, Issue 17-18
Tropical climate variability in the Community Earth System Model: Data Assimilation Research Testbed
journal, December 2019
- Eliashiv, Jonathan; Subramanian, Aneesh C.; Miller, Arthur J.
- Climate Dynamics, Vol. 54, Issue 1-2
Figures / Tables found in this record: