DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: An improved framework for the dynamic likelihood filtering approach to data assimilation

Abstract

We propose improvements to the Dynamic Likelihood Filter (DLF), a Bayesian data assimilation filtering approach, specifically tailored to wave problems. The DLF approach was developed to address the common challenge in the application of data assimilation to hyperbolic problems in the geosciences and in engineering, where observation systems are sparse in space and time. When these observations have low uncertainties, as compared to model uncertainties, the DLF exploits the inherent nature of information and uncertainties to propagate along characteristics to produce estimates that are phase aware as well as amplitude aware, as would be the case in the traditional data assimilation approach. Along characteristics, the stochastic partial differential equations underlying the linear or nonlinear stochastic dynamics are differential equations. This study focuses on developing the explicit challenges of relating dynamics and uncertainties in the Eulerian and Lagrangian frames via dynamic Gaussian processes. It also implements the approach using the ensemble Kalman filter (EnKF) and compares the DLF approach to the conventional one with respect to wave amplitude and phase estimates in linear and nonlinear wave problems. Numerical comparisons show that the DLF/EnKF outperforms the EnKF estimates, when applied to linear and nonlinear wave problems. This advantage is particularly noticeable whenmore » sparse, low uncertainty observations are used.« less

Authors:
ORCiD logo [1]; ORCiD logo [2]
  1. Massachusetts Institute of Technology (MIT), Cambridge, MA (United States)
  2. Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States); University of Tennessee, Knoxville, TN (United States)
Publication Date:
Research Org.:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1906631
Alternate Identifier(s):
OSTI ID: 1867319
Grant/Contract Number:  
AC05-00OR22725
Resource Type:
Accepted Manuscript
Journal Name:
Chaos: An Interdisciplinary Journal of Nonlinear Science
Additional Journal Information:
Journal Volume: 32; Journal Issue: 5; Journal ID: ISSN 1054-1500
Publisher:
American Institute of Physics (AIP)
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING

Citation Formats

Foster, Dallas, and Restrepo, Juan M. An improved framework for the dynamic likelihood filtering approach to data assimilation. United States: N. p., 2022. Web. doi:10.1063/5.0083071.
Foster, Dallas, & Restrepo, Juan M. An improved framework for the dynamic likelihood filtering approach to data assimilation. United States. https://doi.org/10.1063/5.0083071
Foster, Dallas, and Restrepo, Juan M. Tue . "An improved framework for the dynamic likelihood filtering approach to data assimilation". United States. https://doi.org/10.1063/5.0083071. https://www.osti.gov/servlets/purl/1906631.
@article{osti_1906631,
title = {An improved framework for the dynamic likelihood filtering approach to data assimilation},
author = {Foster, Dallas and Restrepo, Juan M.},
abstractNote = {We propose improvements to the Dynamic Likelihood Filter (DLF), a Bayesian data assimilation filtering approach, specifically tailored to wave problems. The DLF approach was developed to address the common challenge in the application of data assimilation to hyperbolic problems in the geosciences and in engineering, where observation systems are sparse in space and time. When these observations have low uncertainties, as compared to model uncertainties, the DLF exploits the inherent nature of information and uncertainties to propagate along characteristics to produce estimates that are phase aware as well as amplitude aware, as would be the case in the traditional data assimilation approach. Along characteristics, the stochastic partial differential equations underlying the linear or nonlinear stochastic dynamics are differential equations. This study focuses on developing the explicit challenges of relating dynamics and uncertainties in the Eulerian and Lagrangian frames via dynamic Gaussian processes. It also implements the approach using the ensemble Kalman filter (EnKF) and compares the DLF approach to the conventional one with respect to wave amplitude and phase estimates in linear and nonlinear wave problems. Numerical comparisons show that the DLF/EnKF outperforms the EnKF estimates, when applied to linear and nonlinear wave problems. This advantage is particularly noticeable when sparse, low uncertainty observations are used.},
doi = {10.1063/5.0083071},
journal = {Chaos: An Interdisciplinary Journal of Nonlinear Science},
number = 5,
volume = 32,
place = {United States},
year = {Tue May 10 00:00:00 EDT 2022},
month = {Tue May 10 00:00:00 EDT 2022}
}

Works referenced in this record:

Review article: Comparison of local particle filters and new implementations
journal, January 2018


A local particle filter for high-dimensional geophysical systems
journal, January 2016

  • Penny, Stephen G.; Miyoshi, Takemasa
  • Nonlinear Processes in Geophysics, Vol. 23, Issue 6
  • DOI: 10.5194/npg-23-391-2016

Ensemble Filtering for Nonlinear Dynamics
journal, November 2003


Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics
journal, January 1994

  • Evensen, Geir
  • Journal of Geophysical Research, Vol. 99, Issue C5
  • DOI: 10.1029/94JC00572

Implications of the Form of the Ensemble Transformation in the Ensemble Square Root Filters
journal, March 2008


A Hybrid Ensemble Transform Particle Filter for Nonlinear and Spatially Extended Dynamical Systems
journal, January 2016

  • Chustagulprom, Nawinda; Reich, Sebastian; Reinhardt, Maria
  • SIAM/ASA Journal on Uncertainty Quantification, Vol. 4, Issue 1
  • DOI: 10.1137/15M1040967

Riemann Solvers and Numerical Methods for Fluid Dynamics
book, January 2009


A deterministic formulation of the ensemble Kalman filter: an alternative to ensemble square root filters
journal, January 2008


Distance-Dependent Filtering of Background Error Covariance Estimates in an Ensemble Kalman Filter
journal, November 2001


A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation
journal, January 2001


Bayesian Filtering and Smoothing
journal, January 2013


Data Assimilation in the Low Noise Regime with Application to the Kuroshio
journal, June 2013


Ensemble Kalman filtering without the intrinsic need for inflation
journal, January 2011


Clawpack: building an open source ecosystem for solving hyperbolic PDEs
journal, January 2016

  • Mandli, Kyle T.; Ahmadia, Aron J.; Berger, Marsha
  • PeerJ Computer Science, Vol. 2
  • DOI: 10.7717/peerj-cs.68

Feature-based data assimilation in geophysics
journal, January 2018

  • Morzfeld, Matthias; Adams, Jesse; Lunderman, Spencer
  • Nonlinear Processes in Geophysics, Vol. 25, Issue 2
  • DOI: 10.5194/npg-25-355-2018

The equivalent-weights particle filter in a high-dimensional system
journal, May 2014

  • Ades, M.; van Leeuwen, P. J.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 141, Issue 687
  • DOI: 10.1002/qj.2370

Displacement data assimilation
journal, February 2017

  • Rosenthal, W. Steven; Venkataramani, Shankar; Mariano, Arthur J.
  • Journal of Computational Physics, Vol. 330
  • DOI: 10.1016/j.jcp.2016.10.025

Comparing Adaptive Prior and Posterior Inflation for Ensemble Filters Using an Atmospheric General Circulation Model
journal, June 2019

  • El Gharamti, Mohamad; Raeder, Kevin; Anderson, Jeffrey
  • Monthly Weather Review, Vol. 147, Issue 7
  • DOI: 10.1175/MWR-D-18-0389.1

A dynamic likelihood approach to filtering: Dynamic Likelihood Approach to Filtering
journal, October 2017

  • Restrepo, J. M.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 143, Issue 708
  • DOI: 10.1002/qj.3143

Accelerated Monte Carlo for Optimal Estimation of Time Series
journal, June 2005

  • Alexander, Francis J.; Eyink, Gregory L.; Restrepo, Juan M.
  • Journal of Statistical Physics, Vol. 119, Issue 5-6
  • DOI: 10.1007/s10955-005-3770-1

Construction of correlation functions in two and three dimensions
journal, January 1999

  • Gaspari, Gregory; Cohn, Stephen E.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 125, Issue 554
  • DOI: 10.1002/qj.49712555417

Sampling strategies and square root analysis schemes for the EnKF
journal, December 2004


A Monte Carlo Implementation of the Nonlinear Filtering Problem to Produce Ensemble Assimilations and Forecasts
journal, December 1999


A Localized Particle Filter for High-Dimensional Nonlinear Systems
journal, January 2016


A New Approach to Linear Filtering and Prediction Problems
journal, March 1960

  • Kalman, R. E.
  • Journal of Basic Engineering, Vol. 82, Issue 1
  • DOI: 10.1115/1.3662552

Data Assimilation
book, January 2016


An adaptive covariance inflation error correction algorithm for ensemble filters
journal, January 2007


A path integral method for data assimilation
journal, January 2008


Quantifying Uncertainty for Coherent Structures
journal, January 2012


A review of operational methods of variational and ensemble-variational data assimilation: Ensemble-variational Data Assimilation
journal, January 2017

  • Bannister, R. N.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 143, Issue 703
  • DOI: 10.1002/qj.2982

Resolution of sharp fronts in the presence of model error in variational data assimilation: Resolution of Sharp Fronts in 4DVar
journal, August 2012

  • Freitag, M. A.; Nichols, N. K.; Budd, C. J.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 139, Issue 672
  • DOI: 10.1002/qj.2002

A local ensemble Kalman filter for atmospheric data assimilation
journal, January 2004

  • Ott, Edward; Hunt, Brian R.; Szunyogh, Istvan
  • Tellus A: Dynamic Meteorology and Oceanography, Vol. 56, Issue 5
  • DOI: 10.3402/tellusa.v56i5.14462

Implicit particle filters for data assimilation
journal, January 2010

  • Chorin, Alexandre; Morzfeld, Matthias; Tu, Xuemin
  • Communications in Applied Mathematics and Computational Science, Vol. 5, Issue 2
  • DOI: 10.2140/camcos.2010.5.221

New High-Resolution Central Schemes for Nonlinear Conservation Laws and Convection–Diffusion Equations
journal, May 2000

  • Kurganov, Alexander; Tadmor, Eitan
  • Journal of Computational Physics, Vol. 160, Issue 1
  • DOI: 10.1006/jcph.2000.6459

Maximum likelihood estimates of linear dynamic systems
journal, August 1965

  • Rauch, H. E.; Tung, F.; Striebel, C. T.
  • AIAA Journal, Vol. 3, Issue 8
  • DOI: 10.2514/3.3166

Ensemble Square Root Filters*
journal, July 2003


The Diffusion Kernel Filter Applied to Lagrangian Data Assimilation
journal, December 2009


Correcting for Position Errors in Variational Data Assimilation
journal, March 2015

  • Nehrkorn, Thomas; Woods, Bryan K.; Hoffman, Ross N.
  • Monthly Weather Review, Vol. 143, Issue 4
  • DOI: 10.1175/MWR-D-14-00127.1