Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Optimal Experimental Design for Inverse Problems in the Presence of Observation Correlations

Journal Article · · SIAM Journal on Scientific Computing
DOI:https://doi.org/10.1137/21M1418666· OSTI ID:1910038

Optimal experimental design (OED) is the general formalism of sensor placement and decisions on the data collection strategy for engineered or natural experiments. This problem is prevalent in many critical fields such as battery design, numerical weather prediction, geosciences, environmental and urban studies. State-of-the-art computational methods for experimental design do not accommodate correlation structure in observational errors produced by many expensive-to-operate devices such as X-ray machines, radars, and satellites. Discarding evident data correlations leads to biased results, higher expenses, and waste of valuable resources. We present a general formulation of the OED formalism for model-constrained large-scale Bayesian linear inverse problems, where measurement errors are generally correlated. The proposed approach utilizes the Hadamard product of matrices to formulate the weighted-likelihood, and is valid for both finite as well as infinite-dimensional Bayesian inverse problems. Extensive numerical experiments are carried out for empirical verification of the proposed approach using an advection-diffusion model, where the objective is to optimally place a small set of sensors, under a limited budget, to predict the concentration of a contaminant in a closed and bounded domain.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
USDOE Office of Science - Office of Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC)
DOE Contract Number:
AC02-06CH11357
OSTI ID:
1910038
Journal Information:
SIAM Journal on Scientific Computing, Vol. 44
Country of Publication:
United States
Language:
English

References (34)

Optimal experimental design for infinite-dimensional Bayesian inverse problems governed by PDEs: a review journal March 2021
A-Optimal Design of Experiments for Infinite-Dimensional Bayesian Linear Inverse Problems with Regularized $\ell_0$-Sparsification journal January 2014
A Fast and Scalable Method for A-Optimal Design of Experiments for Infinite-dimensional Bayesian Nonlinear Inverse Problems journal January 2016
Efficient D-Optimal Design of Experiments for Infinite-Dimensional Bayesian Linear Inverse Problems journal January 2018
Goal-oriented optimal design of experiments for large-scale Bayesian linear inverse problems journal July 2018
Stochastic Learning Approach for Binary Optimization: Application to Bayesian Optimal Design of Experiments journal April 2022
A Hybrid Monte Carlo Sampling Filter for Non-Gaussian Data Assimilation journal January 2015
The reduced-order hybrid Monte Carlo sampling smoother: The reduced-order hybrid Monte Carlo sampling smoother journal June 2016
Randomized algorithms for estimating the trace of an implicit symmetric positive semi-definite matrix journal April 2011
A review of operational methods of variational and ensemble-variational data assimilation: Ensemble-variational Data Assimilation journal January 2017
A Computational Framework for Infinite-Dimensional Bayesian Inverse Problems Part I: The Linearized Case, with Application to Global Seismic Inversion journal January 2013
A Limited Memory Algorithm for Bound Constrained Optimization journal September 1995
Bayesian Experimental Design: A Review journal August 1995
Optimal design for linear models with correlated observations journal February 2013
Design of Experiments in Statistics book January 2000
Construction of correlation functions in two and three dimensions journal January 1999
Numerical methods for experimental design of large-scale linear ill-posed inverse problems journal September 2008
Numerical methods for the design of large-scale nonlinear discrete ill-posed inverse problems journal December 2009
Numerical methods for A-optimal designs with a sparsity constraint for ill-posed inverse problems journal April 2011
Distance-Dependent Filtering of Background Error Covariance Estimates in an Ensemble Kalman Filter journal November 2001
Simulation-based optimal Bayesian experimental design for nonlinear systems journal January 2013
Optimal experimental design under irreducible uncertainty for linear inverse problems governed by PDEs journal July 2020
Sensor Selection for Estimation with Correlated Measurement Noise journal July 2016
�ber monotone Matrixfunktionen journal December 1934
Tuning Covariance Localization Using Machine Learning
  • Moosavi, Azam; Attia, Ahmed; Sandu, Adrian
  • Computational Science – ICCS 2019: 19th International Conference, Faro, Portugal, June 12–14, 2019, Proceedings, Part IV, p. 199-212 https://doi.org/10.1007/978-3-030-22747-0_16
book June 2019
Data Assimilation for Numerical Weather Prediction: A Review book January 2009
A Convergence Theorem in the Theory of $D$-Optimum Experimental Designs journal January 1974
Sampling Decisions in Optimum Experimental Design in the Light of Pontryagin's Maximum Principle journal January 2013
Randomized algorithms for generalized Hermitian eigenvalue problems with application to computing Karhunen-Loève expansion: RANDOMIZED ALGORITHMS FOR GHEP journal November 2015
Optimal sensor location for parameter estimation of distributed processes journal January 2000
D-optimal sensor selection in the presence of correlated measurement noise journal November 2020
Ensemble Data Assimilation without Perturbed Observations journal July 2002
The Sequential Generation of $D$-Optimum Experimental Designs journal October 1970
A scalable design of experiments framework for optimal sensor placement journal July 2018