DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Accuracy of Some Approximate Gaussian Filters for the Navier--Stokes Equation in the Presence of Model Error

Journal Article · · Multiscale Modeling & Simulation
DOI: https://doi.org/10.1137/17m1146865 · OSTI ID:1866715
 [1];  [2];  [3]
  1. Univ. of Edinburgh, Scotland (United Kingdom); Alan Turing Institute for Data Science, London (United Kingdom)
  2. New York Univ. (NYU), NY (United States)
  3. Univ. of Manchester (United Kingdom)

Bayesian state estimation of a dynamical system from a stream of noisy measurements is important in many geophysical and engineering applications where high dimensionality of the state space, sparse observations, and model error pose key challenges. In this work, three computationally feasible, approximate Gaussian data assimilation/filtering algorithms are considered in various regimes of turbulent 2D Navier--Stokes dynamics in the presence of model error. The first source of error arises from the necessary use of reduced models for the forward dynamics of the filters, while a particular type of representation error arises from the finite resolution of observations which mix up information about resolved and unresolved dynamics. Two stochastically parameterized filtering algorithms, referred to as cSPEKF and GCF, are compared with 3DVAR---a prototypical time-sequential algorithm known to be accurate for filtering dissipative systems for a suitably inflated “background” covariance. We provide the first evidence that the stochastically parameterized algorithms, which do not rely on detailed knowledge of the underlying dynamics and do not require covariance inflation, can compete with or outperform an optimally tuned 3DVAR algorithm, and they can overcome competing sources of error in a range of dynamical scenarios.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
US Department of the Navy, Office of Naval Research (ONR); USDOE
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
1866715
Journal Information:
Multiscale Modeling & Simulation, Journal Name: Multiscale Modeling & Simulation Journal Issue: 4 Vol. 16; ISSN 1540-3459
Publisher:
SIAMCopyright Statement
Country of Publication:
United States
Language:
English

References (71)

The equivalent-weights particle filter in a high-dimensional system journal May 2014
A review of forecast error covariance statistics in atmospheric variational data assimilation. I: Characteristics and measurements of forecast error covariances: A REVIEW OF FORECAST ERROR STATISTICS I journal October 2008
A review of forecast error covariance statistics in atmospheric variational data assimilation. II: Modelling the forecast error covariance statistics: A REVIEW OF FORECAST ERROR STATISTICS II journal October 2008
Analysis methods for numerical weather prediction journal October 1986
The ECMWF implementation of three-dimensional variational assimilation (3D-Var). II: Structure functions journal July 1998
Variational quality control journal January 1999
The ECMWF operational implementation of four-dimensional variational assimilation. I: Experimental results with simplified physics journal April 2000
Nonlinear data assimilation in geosciences: an extremely efficient particle filter journal October 2010
Data assimilation in the geosciences: An overview of methods, issues, and perspectives journal July 2018
Exponential Time Differencing for Stiff Systems journal March 2002
Continuous Data Assimilation Using General Interpolant Observables journal November 2013
On the number of determining nodes for the 2D Navier-Stokes equations journal July 1992
Dirichlet quotients and 2D periodic Navier-Stokes equations journal February 1997
Test models for improving filtering with model errors through stochastic parameter estimation journal January 2010
Improving filtering and prediction of spatially extended turbulent systems with model errors through stochastic parameter estimation journal January 2010
Filtering a statistically exactly solvable test model for turbulent tracers from partial observations journal February 2011
Filtering skill for turbulent signals for a suite of nonlinear and linear extended Kalman filters journal February 2012
Dynamic Stochastic Superresolution of sparsely observed turbulent systems journal May 2013
Ensemble Kalman filters for dynamical systems with unresolved turbulence journal September 2014
Discrete data assimilation in the Lorenz and 2D Navier–Stokes equations journal September 2011
Accuracy and stability of filters for dissipative PDEs journal February 2013
Filter accuracy for the Lorenz 96 model: Fixed versus adaptive observation operators journal June 2016
Multilevel sequential Monte Carlo samplers journal May 2017
A stable particle filter for a class of high-dimensional state-space models journal March 2017
Stochastic Models of Quasigeostrophic Turbulence journal March 2004
Inertial Ranges in Two-Dimensional Turbulence journal January 1967
Data assimilation as a nonlinear dynamical systems problem: Stability and convergence of the prediction-assimilation system journal June 2008
Nonuniversal velocity probability densities in two-dimensional turbulence: The effect of large-scale dissipation journal November 2010
Explicit off-line criteria for stable accurate time filtering of strongly unstable spatially extended systems journal January 2007
Concrete ensemble Kalman filters with rigorous catastrophic filter divergence journal August 2015
State estimation and prediction using clustered particle filters journal December 2016
Nonlinear error dynamics for cycled data assimilation methods journal January 2013
Complexity analysis of accelerated MCMC methods for Bayesian inversion journal July 2013
Filtering nonlinear dynamical systems with linear stochastic models journal May 2008
Accuracy and stability of the continuous-time 3DVAR filter for the Navier–Stokes equation journal July 2013
Well-posedness and accuracy of the ensemble Kalman filter in discrete and continuous time journal September 2014
Continuous data assimilation with stochastically noisy data journal February 2015
Determining nodes, finite difference schemes and inertial manifolds journal February 1991
Instability of the Kolmogorov flow in a soap film journal July 1999
Forced-dissipative two-dimensional turbulence: A scaling regime controlled by drag journal April 2009
External Dissipation in Driven Two-Dimensional Turbulence journal July 2000
Asymptotic behavior of the extended Kalman filter as a parameter estimator for linear systems journal February 1979
A New Approach to Linear Filtering and Prediction Problems journal March 1960
Multilevel Particle Filters journal January 2017
Chaos and Weather Forecasting: the role of the Unstable Subspace in Predictability and State Estimation Problems journal December 2011
The National Meteorological Center's Spectral Statistical-Interpolation Analysis System journal August 1992
A System Simulation Approach to Ensemble Prediction journal June 1996
A Monte Carlo Implementation of the Nonlinear Filtering Problem to Produce Ensemble Assimilations and Forecasts journal December 1999
Estimation of Synoptic and Mesoscale Forecast Error Covariances in a Limited-Area Model journal March 2000
A Comparison of Probabilistic Forecasts from Bred, Singular-Vector, and Perturbed Observation Ensembles journal June 2000
Tests of an Ensemble Kalman Filter for Mesoscale and Regional-Scale Data Assimilation. Part IV: Comparison with 3DVAR in a Month-Long Experiment journal October 2008
Obstacles to High-Dimensional Particle Filtering journal December 2008
Particle Filtering in Geophysical Systems journal December 2009
Filtering Turbulent Sparsely Observed Geophysical Flows journal April 2010
Comparison of Ensemble Kalman Filters under Non-Gaussianity journal April 2010
Introduction of the GSI into the NCEP Global Data Assimilation System journal December 2009
The Gaussian Approach to Adaptive Covariance Inflation and Its Implementation with the Local Ensemble Transform Kalman Filter journal May 2011
Intercomparison of an Ensemble Kalman Filter with Three- and Four-Dimensional Variational Data Assimilation Methods in a Limited-Area Model over the Month of June 2003 journal February 2011
E4DVar: Coupling an Ensemble Kalman Filter with Four-Dimensional Variational Data Assimilation in a Limited-Area Weather Prediction Model journal February 2012
New Methods for Estimating Ocean Eddy Heat Transport Using Satellite Altimetry journal May 2012
Evaluating Data Assimilation Algorithms journal November 2012
Convective-Scale Data Assimilation for the Weather Research and Forecasting Model Using the Local Particle Filter journal May 2017
A Wavelet Approach to Representing Background Error Covariances in a Limited-Area Model journal May 2005
Treatment of Observation Error due to Unresolved Scales in Atmospheric Data Assimilation journal October 2006
Can local particle filters beat the curse of dimensionality? journal October 2015
A reformulation of the background error covariance in the ECMWF global data assimilation system journal January 1999
The error of representation: basic understanding journal January 2015
Lessons in uncertainty quantification for turbulent dynamical systems journal January 2012
Catastrophic filter divergence in filtering nonlinear dissipative systems journal January 2010
Nonlinear stability of the ensemble Kalman filter with adaptive covariance inflation journal January 2016
Combining inflation-free and iterative ensemble Kalman filters for strongly nonlinear systems journal January 2012

Cited By (1)