skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Conditions for successful data assimilation

Journal Article · · Journal of Geophysical Research: Atmospheres
DOI:https://doi.org/10.1002/2013jd019838· OSTI ID:1581110
 [1];  [1]
  1. Department of Mathematics, University of California, Berkeley California USA; Lawrence Berkeley National Laboratory, Berkeley California USA

We show, using idealized models, that numerical data assimilation can be successful only if an effective dimension of the problem is not excessive. This effective dimension depends on the noise in the model and the data, and in physically reasonable problems, it can be moderate even when the number of variables is huge. We then analyze several data assimilation algorithms, including particle filters and variational methods. We show that well-designed particle filters can solve most of those data assimilation problems that can be solved in principle and compare the conditions under which variational methods can succeed to the conditions required of particle filters. We also discuss the limitations of our analysis. Key Points Data assimilation is feasible only if an effective dimension is moderate. The effective dimension is moderate, if the noise satisfies a balance condition. Particle filters can work, even if the dimension of the problem is large.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC)
DOE Contract Number:
AC02-05CH11231
OSTI ID:
1581110
Journal Information:
Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 20; ISSN 2169-897X
Publisher:
American Geophysical Union
Country of Publication:
United States
Language:
English

References (35)

An exploration of the equivalent weights particle filter journal August 2012
Implicit Particle Methods and Their Connection with Variational Data Assimilation journal June 2013
Curse-of-dimensionality revisited: Collapse of the particle filter in very large scale systems book January 2008
Ocean Data Assimilation and the Moan Filter: Spatial Regularity journal October 1987
Tropical Cyclone Prediction Using a Barotropic Model Initialized by a Generalized Inverse Method journal June 1993
Beyond Gaussian Statistical Modeling in Geophysical Data Assimilation journal August 2010
Accuracy and stability of filters for dissipative PDEs journal February 2013
Implicit particle filters for data assimilation journal January 2010
Implicit sampling for particle filters journal September 2009
Stochastic Tools in Mathematics and Science book January 2009
Stochastic collocation and mixed finite elements for flow in porous media journal August 2008
Novel approach to nonlinear/non-Gaussian Bayesian state estimation journal January 1993
Conditioning and preconditioning of the variational data assimilation problem journal July 2011
Conditioning of incremental variational data assimilation, with application to the Met Office system journal January 2011
A New Approach to Linear Filtering and Prediction Problems journal March 1960
Upper bounds for the solution of the discrete Riccati equation journal January 1992
Bounds in algebraic Riccati and Lyapunov equations: a survey and some new results journal June 1996
Comparison of Ensemble Kalman Filters under Non-Gaussianity journal April 2010
Blind Deconvolution via Sequential Imputations journal June 1995
Sea surface topography fields of the tropical Pacific from data assimilation journal January 1995
A Kalman Filter Analysis of Sea Level Height in the Tropical Pacific journal June 1989
Implicit particle filtering for models with partial noise, and an application to geomagnetic data assimilation journal January 2012
A random map implementation of implicit filters journal February 2012
Error estimates for assimilation of satellite sea surface temperature data in ocean climate models: MODEL REPRESENTATION ERROR ESTIMATES journal September 2005
Obstacles to High-Dimensional Particle Filtering journal December 2008
Inverse problems: A Bayesian perspective journal May 2010
Variational Assimilation of Meteorological Observations With the Adjoint Vorticity Equation. I: Theory journal October 1987
Ensemble Square Root Filters* journal July 2003
A Variance-Minimizing Filter for Large-Scale Applications journal September 2003
Particle Filtering in Geophysical Systems journal December 2009
Nonlinear data assimilation in geosciences: an extremely efficient particle filter journal October 2010
Data Assimilation in the Low Noise Regime with Application to the Kuroshio journal June 2013
Particle filtering with path sampling and an application to a bimodal ocean current model journal July 2009
Implicit Estimation of Ecological Model Parameters journal January 2013
An efficient, high-order perturbation approach for flow in random porous media via Karhunen–Loève and polynomial expansions journal March 2004