An improved framework for the dynamic likelihood filtering approach to data assimilation
Abstract
We propose improvements to the Dynamic Likelihood Filter (DLF), a Bayesian data assimilation filtering approach, specifically tailored to wave problems. The DLF approach was developed to address the common challenge in the application of data assimilation to hyperbolic problems in the geosciences and in engineering, where observation systems are sparse in space and time. When these observations have low uncertainties, as compared to model uncertainties, the DLF exploits the inherent nature of information and uncertainties to propagate along characteristics to produce estimates that are phase aware as well as amplitude aware, as would be the case in the traditional data assimilation approach. Along characteristics, the stochastic partial differential equations underlying the linear or nonlinear stochastic dynamics are differential equations. This study focuses on developing the explicit challenges of relating dynamics and uncertainties in the Eulerian and Lagrangian frames via dynamic Gaussian processes. It also implements the approach using the ensemble Kalman filter (EnKF) and compares the DLF approach to the conventional one with respect to wave amplitude and phase estimates in linear and nonlinear wave problems. Numerical comparisons show that the DLF/EnKF outperforms the EnKF estimates, when applied to linear and nonlinear wave problems. This advantage is particularly noticeable whenmore »
- Authors:
-
- Massachusetts Institute of Technology (MIT), Cambridge, MA (United States)
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States); University of Tennessee, Knoxville, TN (United States)
- Publication Date:
- Research Org.:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1906631
- Alternate Identifier(s):
- OSTI ID: 1867319
- Grant/Contract Number:
- AC05-00OR22725
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Chaos: An Interdisciplinary Journal of Nonlinear Science
- Additional Journal Information:
- Journal Volume: 32; Journal Issue: 5; Journal ID: ISSN 1054-1500
- Publisher:
- American Institute of Physics (AIP)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING
Citation Formats
Foster, Dallas, and Restrepo, Juan M. An improved framework for the dynamic likelihood filtering approach to data assimilation. United States: N. p., 2022.
Web. doi:10.1063/5.0083071.
Foster, Dallas, & Restrepo, Juan M. An improved framework for the dynamic likelihood filtering approach to data assimilation. United States. https://doi.org/10.1063/5.0083071
Foster, Dallas, and Restrepo, Juan M. Tue .
"An improved framework for the dynamic likelihood filtering approach to data assimilation". United States. https://doi.org/10.1063/5.0083071. https://www.osti.gov/servlets/purl/1906631.
@article{osti_1906631,
title = {An improved framework for the dynamic likelihood filtering approach to data assimilation},
author = {Foster, Dallas and Restrepo, Juan M.},
abstractNote = {We propose improvements to the Dynamic Likelihood Filter (DLF), a Bayesian data assimilation filtering approach, specifically tailored to wave problems. The DLF approach was developed to address the common challenge in the application of data assimilation to hyperbolic problems in the geosciences and in engineering, where observation systems are sparse in space and time. When these observations have low uncertainties, as compared to model uncertainties, the DLF exploits the inherent nature of information and uncertainties to propagate along characteristics to produce estimates that are phase aware as well as amplitude aware, as would be the case in the traditional data assimilation approach. Along characteristics, the stochastic partial differential equations underlying the linear or nonlinear stochastic dynamics are differential equations. This study focuses on developing the explicit challenges of relating dynamics and uncertainties in the Eulerian and Lagrangian frames via dynamic Gaussian processes. It also implements the approach using the ensemble Kalman filter (EnKF) and compares the DLF approach to the conventional one with respect to wave amplitude and phase estimates in linear and nonlinear wave problems. Numerical comparisons show that the DLF/EnKF outperforms the EnKF estimates, when applied to linear and nonlinear wave problems. This advantage is particularly noticeable when sparse, low uncertainty observations are used.},
doi = {10.1063/5.0083071},
journal = {Chaos: An Interdisciplinary Journal of Nonlinear Science},
number = 5,
volume = 32,
place = {United States},
year = {Tue May 10 00:00:00 EDT 2022},
month = {Tue May 10 00:00:00 EDT 2022}
}
Works referenced in this record:
Review article: Comparison of local particle filters and new implementations
journal, January 2018
- Farchi, Alban; Bocquet, Marc
- Nonlinear Processes in Geophysics, Vol. 25, Issue 4
A local particle filter for high-dimensional geophysical systems
journal, January 2016
- Penny, Stephen G.; Miyoshi, Takemasa
- Nonlinear Processes in Geophysics, Vol. 23, Issue 6
Ensemble Filtering for Nonlinear Dynamics
journal, November 2003
- Kim, Sangil; Eyink, Gregory L.; Restrepo, Juan M.
- Monthly Weather Review, Vol. 131, Issue 11
Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics
journal, January 1994
- Evensen, Geir
- Journal of Geophysical Research, Vol. 99, Issue C5
Implications of the Form of the Ensemble Transformation in the Ensemble Square Root Filters
journal, March 2008
- Sakov, Pavel; Oke, Peter R.
- Monthly Weather Review, Vol. 136, Issue 3
A Hybrid Ensemble Transform Particle Filter for Nonlinear and Spatially Extended Dynamical Systems
journal, January 2016
- Chustagulprom, Nawinda; Reich, Sebastian; Reinhardt, Maria
- SIAM/ASA Journal on Uncertainty Quantification, Vol. 4, Issue 1
A deterministic formulation of the ensemble Kalman filter: an alternative to ensemble square root filters
journal, January 2008
- Sakov, Pavel; Oke, Peter R.
- Tellus A: Dynamic Meteorology and Oceanography, Vol. 60, Issue 2
Distance-Dependent Filtering of Background Error Covariance Estimates in an Ensemble Kalman Filter
journal, November 2001
- Hamill, Thomas M.; Whitaker, Jeffrey S.; Snyder, Chris
- Monthly Weather Review, Vol. 129, Issue 11
Stochastic Methods for Sequential Data Assimilation in Strongly Nonlinear Systems
journal, May 2001
- Pham, Dinh Tuan
- Monthly Weather Review, Vol. 129, Issue 5
A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation
journal, January 2001
- Houtekamer, P. L.; Mitchell, Herschel L.
- Monthly Weather Review, Vol. 129, Issue 1
Data Assimilation in the Low Noise Regime with Application to the Kuroshio
journal, June 2013
- Vanden-Eijnden, Eric; Weare, Jonathan
- Monthly Weather Review, Vol. 141, Issue 6
Ensemble Kalman filtering without the intrinsic need for inflation
journal, January 2011
- Bocquet, M.
- Nonlinear Processes in Geophysics, Vol. 18, Issue 5
Clawpack: building an open source ecosystem for solving hyperbolic PDEs
journal, January 2016
- Mandli, Kyle T.; Ahmadia, Aron J.; Berger, Marsha
- PeerJ Computer Science, Vol. 2
Feature-based data assimilation in geophysics
journal, January 2018
- Morzfeld, Matthias; Adams, Jesse; Lunderman, Spencer
- Nonlinear Processes in Geophysics, Vol. 25, Issue 2
The equivalent-weights particle filter in a high-dimensional system
journal, May 2014
- Ades, M.; van Leeuwen, P. J.
- Quarterly Journal of the Royal Meteorological Society, Vol. 141, Issue 687
Displacement data assimilation
journal, February 2017
- Rosenthal, W. Steven; Venkataramani, Shankar; Mariano, Arthur J.
- Journal of Computational Physics, Vol. 330
Comparing Adaptive Prior and Posterior Inflation for Ensemble Filters Using an Atmospheric General Circulation Model
journal, June 2019
- El Gharamti, Mohamad; Raeder, Kevin; Anderson, Jeffrey
- Monthly Weather Review, Vol. 147, Issue 7
A dynamic likelihood approach to filtering: Dynamic Likelihood Approach to Filtering
journal, October 2017
- Restrepo, J. M.
- Quarterly Journal of the Royal Meteorological Society, Vol. 143, Issue 708
Accelerated Monte Carlo for Optimal Estimation of Time Series
journal, June 2005
- Alexander, Francis J.; Eyink, Gregory L.; Restrepo, Juan M.
- Journal of Statistical Physics, Vol. 119, Issue 5-6
Construction of correlation functions in two and three dimensions
journal, January 1999
- Gaspari, Gregory; Cohn, Stephen E.
- Quarterly Journal of the Royal Meteorological Society, Vol. 125, Issue 554
Sampling strategies and square root analysis schemes for the EnKF
journal, December 2004
- Evensen, Geir
- Ocean Dynamics, Vol. 54, Issue 6
A Monte Carlo Implementation of the Nonlinear Filtering Problem to Produce Ensemble Assimilations and Forecasts
journal, December 1999
- Anderson, Jeffrey L.; Anderson, Stephen L.
- Monthly Weather Review, Vol. 127, Issue 12
A Localized Particle Filter for High-Dimensional Nonlinear Systems
journal, January 2016
- Poterjoy, Jonathan
- Monthly Weather Review, Vol. 144, Issue 1
A New Approach to Linear Filtering and Prediction Problems
journal, March 1960
- Kalman, R. E.
- Journal of Basic Engineering, Vol. 82, Issue 1
An adaptive covariance inflation error correction algorithm for ensemble filters
journal, January 2007
- Anderson, Jeffrey L.
- Tellus A: Dynamic Meteorology and Oceanography, Vol. 59, Issue 2
A path integral method for data assimilation
journal, January 2008
- Restrepo, Juan M.
- Physica D: Nonlinear Phenomena, Vol. 237, Issue 1
Quantifying Uncertainty for Coherent Structures
journal, January 2012
- Ravela, S.
- Procedia Computer Science, Vol. 9
A review of operational methods of variational and ensemble-variational data assimilation: Ensemble-variational Data Assimilation
journal, January 2017
- Bannister, R. N.
- Quarterly Journal of the Royal Meteorological Society, Vol. 143, Issue 703
Resolution of sharp fronts in the presence of model error in variational data assimilation: Resolution of Sharp Fronts in 4DVar
journal, August 2012
- Freitag, M. A.; Nichols, N. K.; Budd, C. J.
- Quarterly Journal of the Royal Meteorological Society, Vol. 139, Issue 672
A local ensemble Kalman filter for atmospheric data assimilation
journal, January 2004
- Ott, Edward; Hunt, Brian R.; Szunyogh, Istvan
- Tellus A: Dynamic Meteorology and Oceanography, Vol. 56, Issue 5
Implicit particle filters for data assimilation
journal, January 2010
- Chorin, Alexandre; Morzfeld, Matthias; Tu, Xuemin
- Communications in Applied Mathematics and Computational Science, Vol. 5, Issue 2
New High-Resolution Central Schemes for Nonlinear Conservation Laws and Convection–Diffusion Equations
journal, May 2000
- Kurganov, Alexander; Tadmor, Eitan
- Journal of Computational Physics, Vol. 160, Issue 1
Maximum likelihood estimates of linear dynamic systems
journal, August 1965
- Rauch, H. E.; Tung, F.; Striebel, C. T.
- AIAA Journal, Vol. 3, Issue 8
Ensemble Square Root Filters*
journal, July 2003
- Tippett, Michael K.; Anderson, Jeffrey L.; Bishop, Craig H.
- Monthly Weather Review, Vol. 131, Issue 7
The Diffusion Kernel Filter Applied to Lagrangian Data Assimilation
journal, December 2009
- Krause, Paul; Restrepo, Juan M.
- Monthly Weather Review, Vol. 137, Issue 12
Correcting for Position Errors in Variational Data Assimilation
journal, March 2015
- Nehrkorn, Thomas; Woods, Bryan K.; Hoffman, Ross N.
- Monthly Weather Review, Vol. 143, Issue 4