DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization

Abstract

In many situations across computational science and engineering, multiple computational models are available that describe a system of interest. These different models have varying evaluation costs and varying fidelities. Typically, a computationally expensive high-fidelity model describes the system with the accuracy required by the current application at hand, while lower-fidelity models are less accurate but computationally cheaper than the high-fidelity model. Outer-loop applications, such as optimization, inference, and uncertainty quantification, require multiple model evaluations at many different inputs, which often leads to computational demands that exceed available resources if only the high-fidelity model is used. This work surveys multifidelity methods that accelerate the solution of outer-loop applications by combining high-fidelity and low-fidelity model evaluations, where the low-fidelity evaluations arise from an explicit low-fidelity model (e.g., a simplified physics approximation, a reduced model, a data-fit surrogate) that approximates the same output quantity as the high-fidelity model. The overall premise of these multifidelity methods is that low-fidelity models are leveraged for speedup while the high-fidelity model is kept in the loop to establish accuracy and/or convergence guarantees. We categorize multifidelity methods according to three classes of strategies: adaptation, fusion, and filtering. The paper reviews multifidelity methods in the outer-loop contexts of uncertaintymore » propagation, inference, and optimization.« less

Authors:
 [1];  [2];  [3]
  1. Univ. of Wisconsin, Madison, WI (United States)
  2. Massachusetts Inst. of Technology (MIT), Cambridge, MA (United States)
  3. Florida State Univ., Tallahassee, FL (United States)
Publication Date:
Research Org.:
Massachusetts Inst. of Technology (MIT), Cambridge, MA (United States); Florida State Univ., Tallahassee, FL (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1500214
Grant/Contract Number:  
SC0009297; SC0009324
Resource Type:
Accepted Manuscript
Journal Name:
SIAM Review
Additional Journal Information:
Journal Volume: 60; Journal Issue: 3; Journal ID: ISSN 0036-1445
Publisher:
Society for Industrial and Applied Mathematics
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING

Citation Formats

Peherstorfer, Benjamin, Willcox, Karen, and Gunzburger, Max. Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization. United States: N. p., 2018. Web. doi:10.1137/16m1082469.
Peherstorfer, Benjamin, Willcox, Karen, & Gunzburger, Max. Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization. United States. https://doi.org/10.1137/16m1082469
Peherstorfer, Benjamin, Willcox, Karen, and Gunzburger, Max. Wed . "Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization". United States. https://doi.org/10.1137/16m1082469. https://www.osti.gov/servlets/purl/1500214.
@article{osti_1500214,
title = {Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization},
author = {Peherstorfer, Benjamin and Willcox, Karen and Gunzburger, Max},
abstractNote = {In many situations across computational science and engineering, multiple computational models are available that describe a system of interest. These different models have varying evaluation costs and varying fidelities. Typically, a computationally expensive high-fidelity model describes the system with the accuracy required by the current application at hand, while lower-fidelity models are less accurate but computationally cheaper than the high-fidelity model. Outer-loop applications, such as optimization, inference, and uncertainty quantification, require multiple model evaluations at many different inputs, which often leads to computational demands that exceed available resources if only the high-fidelity model is used. This work surveys multifidelity methods that accelerate the solution of outer-loop applications by combining high-fidelity and low-fidelity model evaluations, where the low-fidelity evaluations arise from an explicit low-fidelity model (e.g., a simplified physics approximation, a reduced model, a data-fit surrogate) that approximates the same output quantity as the high-fidelity model. The overall premise of these multifidelity methods is that low-fidelity models are leveraged for speedup while the high-fidelity model is kept in the loop to establish accuracy and/or convergence guarantees. We categorize multifidelity methods according to three classes of strategies: adaptation, fusion, and filtering. The paper reviews multifidelity methods in the outer-loop contexts of uncertainty propagation, inference, and optimization.},
doi = {10.1137/16m1082469},
journal = {SIAM Review},
number = 3,
volume = 60,
place = {United States},
year = {Wed Aug 08 00:00:00 EDT 2018},
month = {Wed Aug 08 00:00:00 EDT 2018}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 384 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

A trust-region framework for managing the use of approximation models in optimization
journal, February 1998

  • Alexandrov, N. M.; Dennis, J. E.; Lewis, R. M.
  • Structural Optimization, Vol. 15, Issue 1
  • DOI: 10.1007/BF01197433

Approximation and Model Management in Aerodynamic Optimization with Variable-Fidelity Models
journal, November 2001

  • Alexandrov, Natalia M.; Lewis, Robert Michael; Gumbert, Clyde R.
  • Journal of Aircraft, Vol. 38, Issue 6
  • DOI: 10.2514/2.2877

A Mathematical and Computational Framework for Multifidelity Design and Analysis with Computer Models
journal, January 2014


Fast local reduced basis updates for the efficient reduction of nonlinear systems with hyper-reduction
journal, February 2015

  • Amsallem, David; Zahr, Matthew J.; Washabaugh, Kyle
  • Advances in Computational Mathematics, Vol. 41, Issue 5
  • DOI: 10.1007/s10444-015-9409-0

Iterative Procedures for Nonlinear Integral Equations
journal, October 1965


The principle of minimized iterations in the solution of the matrix eigenvalue problem
journal, January 1951

  • Arnoldi, W. E.
  • Quarterly of Applied Mathematics, Vol. 9, Issue 1
  • DOI: 10.1090/qam/42792

Approximation errors and model reduction with an application in optical diffusion tomography
journal, January 2006


A Stochastic Collocation Method for Elliptic Partial Differential Equations with Random Input Data
journal, January 2007

  • Babuška, Ivo; Nobile, Fabio; Tempone, Raúl
  • SIAM Journal on Numerical Analysis, Vol. 45, Issue 3
  • DOI: 10.1137/050645142

Worst case scenario analysis for elliptic problems with uncertainty
journal, June 2005


Krylov subspace techniques for reduced-order modeling of large-scale dynamical systems
journal, October 2002


The hierarchical basis multigrid method
journal, July 1988

  • Bank, Randolph E.; Dupont, Todd F.; Yserentant, Harry
  • Numerische Mathematik, Vol. 52, Issue 4
  • DOI: 10.1007/BF01462238

Approximation concepts for optimum structural design — a review
journal, September 1993

  • Barthelemy, J. -F. M.; Haftka, R. T.
  • Structural Optimization, Vol. 5, Issue 3
  • DOI: 10.1007/BF01743349

An improved adaptive sampling scheme for the construction of explicit boundaries
journal, May 2010

  • Basudhar, Anirban; Missoum, Samy
  • Structural and Multidisciplinary Optimization, Vol. 42, Issue 4
  • DOI: 10.1007/s00158-010-0511-0

Interpolatory Projection Methods for Parameterized Model Reduction
journal, January 2011

  • Baur, Ulrike; Beattie, Christopher; Benner, Peter
  • SIAM Journal on Scientific Computing, Vol. 33, Issue 5
  • DOI: 10.1137/090776925

A Framework for Validation of Computer Models
journal, May 2007


A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems
journal, January 2015

  • Benner, Peter; Gugercin, Serkan; Willcox, Karen
  • SIAM Review, Vol. 57, Issue 4
  • DOI: 10.1137/130932715

Optimal control of the cylinder wake in the laminar regime by trust-region methods and POD reduced-order models
journal, August 2008


The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows
journal, January 1993


A rigorous framework for optimization of expensive functions by surrogates
journal, February 1999

  • Booker, A. J.; Dennis, J. E.; Frank, P. D.
  • Structural Optimization, Vol. 17, Issue 1
  • DOI: 10.1007/BF01197708

A fast Monte–Carlo method with a reduced basis of control variates applied to uncertainty propagation and Bayesian estimation
journal, October 2012


Parallel multilevel preconditioners
journal, September 1990


Multi-level adaptive solutions to boundary-value problems
journal, May 1977


A class of methods for solving nonlinear simultaneous equations
journal, January 1965


Sparse grids
journal, May 2004


POD and CVT-based reduced-order modeling of Navier–Stokes flows
journal, December 2006

  • Burkardt, John; Gunzburger, Max; Lee, Hyung-Chun
  • Computer Methods in Applied Mechanics and Engineering, Vol. 196, Issue 1-3
  • DOI: 10.1016/j.cma.2006.04.004

Finite Element Approximations for Stokes–Darcy Flow with Beavers–Joseph Interface Conditions
journal, January 2010

  • Cao, Yanzhao; Gunzburger, Max; Hu, Xiaolong
  • SIAM Journal on Numerical Analysis, Vol. 47, Issue 6
  • DOI: 10.1137/080731542

Analysis and finite element approximation of a coupled, continuum pipe-flow/Darcy model for flow in porous media with embedded conduits
journal, March 2010

  • Cao, Yanzhao; Gunzburger, Max; Hua, Fei
  • Numerical Methods for Partial Differential Equations, Vol. 27, Issue 5
  • DOI: 10.1002/num.20579

Adaptive h -refinement for reduced-order models : ADAPTIVE
journal, November 2014

  • Carlberg, Kevin
  • International Journal for Numerical Methods in Engineering, Vol. 102, Issue 5
  • DOI: 10.1002/nme.4800

LIBSVM: A library for support vector machines
journal, April 2011

  • Chang, Chih-Chung; Lin, Chih-Jen
  • ACM Transactions on Intelligent Systems and Technology, Vol. 2, Issue 3
  • DOI: 10.1145/1961189.1961199

Nonlinear Model Reduction via Discrete Empirical Interpolation
journal, January 2010

  • Chaturantabut, Saifon; Sorensen, Danny C.
  • SIAM Journal on Scientific Computing, Vol. 32, Issue 5
  • DOI: 10.1137/090766498

Efficient Global Optimization with Adaptive Target Setting
journal, July 2014

  • Chaudhuri, Anirban; Haftka, Raphael T.
  • AIAA Journal, Vol. 52, Issue 7
  • DOI: 10.2514/1.J052930

Accurate and efficient evaluation of failure probability for partial different equations with random input data
journal, December 2013

  • Chen, Peng; Quarteroni, Alfio
  • Computer Methods in Applied Mechanics and Engineering, Vol. 267
  • DOI: 10.1016/j.cma.2013.08.016

Two-Level Multifidelity Design Optimization Studies for Supersonic Jets
journal, May 2009

  • Choi, Seongim; Alonso, Juan J.; Kroo, Ilan M.
  • Journal of Aircraft, Vol. 46, Issue 3
  • DOI: 10.2514/1.34362

Multifidelity Design Optimization of Low-Boom Supersonic Jets
journal, January 2008

  • Choi, Seongim; Alonso, Juan J.; Kroo, Illan M.
  • Journal of Aircraft, Vol. 45, Issue 1
  • DOI: 10.2514/1.28948

Markov chain Monte Carlo Using an Approximation
journal, December 2005

  • Christen, J. Andrés; Fox, Colin
  • Journal of Computational and Graphical Statistics, Vol. 14, Issue 4
  • DOI: 10.1198/106186005X76983

Multilevel Monte Carlo methods and applications to elliptic PDEs with random coefficients
journal, January 2011

  • Cliffe, K. A.; Giles, M. B.; Scheichl, R.
  • Computing and Visualization in Science, Vol. 14, Issue 1
  • DOI: 10.1007/s00791-011-0160-x

Global Convergence of General Derivative-Free Trust-Region Algorithms to First- and Second-Order Critical Points
journal, January 2009

  • Conn, Andrew R.; Scheinberg, Katya; Vicente, Luís N.
  • SIAM Journal on Optimization, Vol. 20, Issue 1
  • DOI: 10.1137/060673424

Support-vector networks
journal, September 1995

  • Cortes, Corinna; Vapnik, Vladimir
  • Machine Learning, Vol. 20, Issue 3
  • DOI: 10.1007/BF00994018

MCMC Methods for Functions: Modifying Old Algorithms to Make Them Faster
journal, August 2013

  • Cotter, S. L.; Roberts, G. O.; Stuart, A. M.
  • Statistical Science, Vol. 28, Issue 3
  • DOI: 10.1214/13-STS421

Dimension-independent likelihood-informed MCMC
journal, January 2016

  • Cui, Tiangang; Law, Kody J. H.; Marzouk, Youssef M.
  • Journal of Computational Physics, Vol. 304
  • DOI: 10.1016/j.jcp.2015.10.008

Likelihood-informed dimension reduction for nonlinear inverse problems
journal, October 2014


Data-driven model reduction for the Bayesian solution of inverse problems: DATA-DRIVEN MODEL REDUCTION FOR INVERSE PROBLEMS
journal, August 2014

  • Cui, Tiangang; Marzouk, Youssef M.; Willcox, Karen E.
  • International Journal for Numerical Methods in Engineering, Vol. 102, Issue 5
  • DOI: 10.1002/nme.4748

Multilevel preconditioning
journal, December 1992

  • Dahmen, Wolfgang; Kunoth, Angela
  • Numerische Mathematik, Vol. 63, Issue 1
  • DOI: 10.1007/BF01385864

Variable Metric Method for Minimization
journal, February 1991

  • Davidon, William C.
  • SIAM Journal on Optimization, Vol. 1, Issue 1
  • DOI: 10.1137/0801001

A Hierarchical Multilevel Markov Chain Monte Carlo Algorithm with Applications to Uncertainty Quantification in Subsurface Flow
journal, January 2015

  • Dodwell, T. J.; Ketelsen, C.; Scheichl, R.
  • SIAM/ASA Journal on Uncertainty Quantification, Vol. 3, Issue 1
  • DOI: 10.1137/130915005

A multifidelity approach for the construction of explicit decision boundaries: application to aeroelasticity
journal, June 2010

  • Dribusch, Christoph; Missoum, Samy; Beran, Philip
  • Structural and Multidisciplinary Optimization, Vol. 42, Issue 5
  • DOI: 10.1007/s00158-010-0516-8

Centroidal Voronoi Tessellations: Applications and Algorithms
journal, January 1999


Preconditioning Markov Chain Monte Carlo Simulations Using Coarse-Scale Models
journal, January 2006

  • Efendiev, Y.; Hou, T.; Luo, W.
  • SIAM Journal on Scientific Computing, Vol. 28, Issue 2
  • DOI: 10.1137/050628568

Improving Simulation Efficiency with Quasi Control Variates
journal, September 2002


Efficient linear circuit analysis by Pade approximation via the Lanczos process
journal, May 1995

  • Feldmann, P.; Freund, R. W.
  • IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, Vol. 14, Issue 5
  • DOI: 10.1109/43.384428

A Rapidly Convergent Descent Method for Minimization
journal, August 1963


Recent advances in surrogate-based optimization
journal, January 2009


Multi-fidelity optimization via surrogate modelling
journal, September 2007

  • Forrester, Alexander I. J.; Sóbester, András; Keane, Andy J.
  • Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 463, Issue 2088
  • DOI: 10.1098/rspa.2007.1900

Model reduction methods based on Krylov subspaces
journal, May 2003


Multilevel Monte Carlo Path Simulation
journal, June 2008


Adaptive Markov Chain Monte Carlo through Regeneration
journal, September 1998

  • Gilks, Walter R.; Roberts, Gareth O.; Sahu, Sujit K.
  • Journal of the American Statistical Association, Vol. 93, Issue 443
  • DOI: 10.1080/01621459.1998.10473766

Riemann manifold Langevin and Hamiltonian Monte Carlo methods: Riemann Manifold Langevin and Hamiltonian Monte Carlo Methods
journal, March 2011

  • Girolami, Mark; Calderhead, Ben
  • Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 73, Issue 2
  • DOI: 10.1111/j.1467-9868.2010.00765.x

Ensemble of surrogates
journal, September 2006

  • Goel, Tushar; Haftka, Raphael T.; Shyy, Wei
  • Structural and Multidisciplinary Optimization, Vol. 33, Issue 3
  • DOI: 10.1007/s00158-006-0051-9

Modeling an Augmented Lagrangian for Blackbox Constrained Optimization
journal, January 2016


Bayesian Treed Gaussian Process Models With an Application to Computer Modeling
journal, September 2008

  • Gramacy, Robert B.; Lee, Herbert K. H.
  • Journal of the American Statistical Association, Vol. 103, Issue 483
  • DOI: 10.1198/016214508000000689

Adaptive Design and Analysis of Supercomputer Experiments
journal, May 2009


Delayed rejection in reversible jump Metropolis-Hastings
journal, December 2001


Efficient reduced-basis treatment of nonaffine and nonlinear partial differential equations
journal, May 2007

  • Grepl, Martin A.; Maday, Yvon; Nguyen, Ngoc C.
  • ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 41, Issue 3
  • DOI: 10.1051/m2an:2007031

$\mathcal{H}_2$ Model Reduction for Large-Scale Linear Dynamical Systems
journal, January 2008

  • Gugercin, S.; Antoulas, A. C.; Beattie, C.
  • SIAM Journal on Matrix Analysis and Applications, Vol. 30, Issue 2
  • DOI: 10.1137/060666123

A Survey of Model Reduction by Balanced Truncation and Some New Results
journal, May 2004


Stochastic finite element methods for partial differential equations with random input data
journal, May 2014


An Adaptive Metropolis Algorithm
journal, April 2001

  • Haario, Heikki; Saksman, Eero; Tamminen, Johanna
  • Bernoulli, Vol. 7, Issue 2
  • DOI: 10.2307/3318737

Convergence Rates of the POD–Greedy Method
journal, April 2013

  • Haasdonk, Bernard
  • ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 47, Issue 3
  • DOI: 10.1051/m2an/2012045

Reduced basis method for finite volume approximations of parametrized linear evolution equations
journal, March 2008

  • Haasdonk, Bernard; Ohlberger, Mario
  • ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 42, Issue 2
  • DOI: 10.1051/m2an:2008001

Combining global and local approximations
journal, September 1991


Multi-index Monte Carlo: when sparsity meets sampling
journal, June 2015

  • Haji-Ali, Abdul-Lateef; Nobile, Fabio; Tempone, Raúl
  • Numerische Mathematik, Vol. 132, Issue 4
  • DOI: 10.1007/s00211-015-0734-5

Improving variable-fidelity surrogate modeling via gradient-enhanced kriging and a generalized hybrid bridge function
journal, March 2013

  • Han, Zhong-Hua; Görtz, Stefan; Zimmermann, Ralf
  • Aerospace Science and Technology, Vol. 25, Issue 1
  • DOI: 10.1016/j.ast.2012.01.006

The Gap between Simulation and Understanding in Climate Modeling
journal, November 2005


Combining Field Data and Computer Simulations for Calibration and Prediction
journal, January 2004

  • Higdon, Dave; Kennedy, Marc; Cavendish, James C.
  • SIAM Journal on Scientific Computing, Vol. 26, Issue 2
  • DOI: 10.1137/S1064827503426693

Error estimates for abstract linear–quadratic optimal control problems using proper orthogonal decomposition
journal, August 2007


Approximation errors in nonstationary inverse problems
journal, January 2007

  • M. J. Huttunen, Janne; P. Kaipio, J.
  • Inverse Problems & Imaging, Vol. 1, Issue 1
  • DOI: 10.3934/ipi.2007.1.77

Approximation error analysis in nonlinear state estimation with an application to state-space identification
journal, September 2007


A successive constraint linear optimization method for lower bounds of parametric coercivity and inf–sup stability constants
journal, October 2007


A Taxonomy of Global Optimization Methods Based on Response Surfaces
journal, December 2001


Efficient Global Optimization of Expensive Black-Box Functions
journal, January 1998

  • Jones, Donald R.; Schonlau, Matthias; Welch, William J.
  • Journal of Global Optimization, Vol. 13, Issue 4, p. 455-492
  • DOI: 10.1023/A:1008306431147

Statistical inverse problems: Discretization, model reduction and inverse crimes
journal, January 2007

  • Kaipio, Jari; Somersalo, Erkki
  • Journal of Computational and Applied Mathematics, Vol. 198, Issue 2
  • DOI: 10.1016/j.cam.2005.09.027

Wing Optimization Using Design of Experiment, Response Surface, and Data Fusion Methods
journal, July 2003

  • Keane, A. J.
  • Journal of Aircraft, Vol. 40, Issue 4
  • DOI: 10.2514/2.3153

Bayesian calibration of computer models
journal, August 2001

  • Kennedy, Marc C.; O'Hagan, Anthony
  • Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 63, Issue 3
  • DOI: 10.1111/1467-9868.00294

Exaflop/s: The why and the how
journal, February 2011


Accurate Uncertainty Quantification Using Inaccurate Computational Models
journal, January 2009

  • Koutsourelakis, Phaedon-Stelios
  • SIAM Journal on Scientific Computing, Vol. 31, Issue 5
  • DOI: 10.1137/080733565

Galerkin proper orthogonal decomposition methods for parabolic problems
journal, November 2001


Galerkin Proper Orthogonal Decomposition Methods for a General Equation in Fluid Dynamics
journal, January 2002


An iteration method for the solution of the eigenvalue problem of linear differential and integral operators
journal, October 1950

  • Lanczos, C.
  • Journal of Research of the National Bureau of Standards, Vol. 45, Issue 4
  • DOI: 10.6028/jres.045.026

Solution of systems of linear equations by minimized iterations
journal, July 1952

  • Lanczos, C.
  • Journal of Research of the National Bureau of Standards, Vol. 49, Issue 1
  • DOI: 10.6028/jres.049.006

Building Efficient Response Surfaces of Aerodynamic Functions with Kriging and Cokriging
journal, February 2008

  • Laurenceau, J.; Sagaut, P.
  • AIAA Journal, Vol. 46, Issue 2
  • DOI: 10.2514/1.32308

Approximation errors and truncation of computational domains with application to geophysical tomography
journal, January 2007

  • Lehikoinen, A.; Finsterle, S.; Voutilainen, A.
  • Inverse Problems & Imaging, Vol. 1, Issue 2
  • DOI: 10.3934/ipi.2007.1.371

A method for the solution of certain non-linear problems in least squares
journal, January 1944

  • Levenberg, Kenneth
  • Quarterly of Applied Mathematics, Vol. 2, Issue 2
  • DOI: 10.1090/qam/10666

An efficient surrogate-based method for computing rare failure probability
journal, October 2011


Evaluation of failure probability via surrogate models
journal, November 2010


Model Weights and the Foundations of Multimodel Inference
journal, October 2006


Quantifying uncertainty in climate change science through empirical information theory
journal, August 2010

  • Majda, A. J.; Gershgorin, B.
  • Proceedings of the National Academy of Sciences, Vol. 107, Issue 34
  • DOI: 10.1073/pnas.1007009107

Constrained multifidelity optimization using model calibration
journal, January 2012

  • March, Andrew; Willcox, Karen
  • Structural and Multidisciplinary Optimization, Vol. 46, Issue 1
  • DOI: 10.1007/s00158-011-0749-1

Provably Convergent Multifidelity Optimization Algorithm Not Requiring High-Fidelity Derivatives
journal, May 2012

  • March, Andrew; Willcox, Karen
  • AIAA Journal, Vol. 50, Issue 5
  • DOI: 10.2514/1.J051125

An Algorithm for Least-Squares Estimation of Nonlinear Parameters
journal, June 1963

  • Marquardt, Donald W.
  • Journal of the Society for Industrial and Applied Mathematics, Vol. 11, Issue 2
  • DOI: 10.1137/0111030

A Stochastic Newton MCMC Method for Large-Scale Statistical Inverse Problems with Application to Seismic Inversion
journal, January 2012

  • Martin, James; Wilcox, Lucas C.; Burstedde, Carsten
  • SIAM Journal on Scientific Computing, Vol. 34, Issue 3
  • DOI: 10.1137/110845598

Use of Kriging Models to Approximate Deterministic Computer Models
journal, April 2005

  • Martin, Jay D.; Simpson, Timothy W.
  • AIAA Journal, Vol. 43, Issue 4
  • DOI: 10.2514/1.8650

Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
journal, April 2009


Principles of geostatistics
journal, December 1963


Efficient statistical classification of satellite measurements
journal, July 2011


Principal component analysis in linear systems: Controllability, observability, and model reduction
journal, February 1981


Synthesis of minimum roundoff noise fixed point digital filters
journal, September 1976


A Stochastic Collocation Algorithm with Multifidelity Models
journal, January 2014

  • Narayan, Akil; Gittelson, Claude; Xiu, Dongbin
  • SIAM Journal on Scientific Computing, Vol. 36, Issue 2
  • DOI: 10.1137/130929461

On control variate estimators
journal, January 1987


Multifidelity approaches for optimization under uncertainty: MULTIFIDELITY APPROACHES FOR OPTIMIZATION UNDER UNCERTAINTY
journal, September 2014

  • Ng, Leo W. T.; Willcox, Karen E.
  • International Journal for Numerical Methods in Engineering, Vol. 100, Issue 10
  • DOI: 10.1002/nme.4761

Monte Carlo Information-Reuse Approach to Aircraft Conceptual Design Optimization Under Uncertainty
journal, March 2016

  • Ng, Leo W. T.; Willcox, Karen E.
  • Journal of Aircraft, Vol. 53, Issue 2
  • DOI: 10.2514/1.C033352

The Bayesian approximation error approach for electrical impedance tomography—experimental results
journal, November 2007


A Sparse Grid Stochastic Collocation Method for Partial Differential Equations with Random Input Data
journal, January 2008

  • Nobile, F.; Tempone, R.; Webster, C. G.
  • SIAM Journal on Numerical Analysis, Vol. 46, Issue 5
  • DOI: 10.1137/060663660

A Multi Level Monte Carlo method with control variate for elliptic PDEs with log-normal coefficients
journal, July 2015

  • Nobile, Fabio; Tesei, Francesco
  • Stochastic Partial Differential Equations: Analysis and Computations, Vol. 3, Issue 3
  • DOI: 10.1007/s40072-015-0055-9

Bayesian inference for the uncertainty distribution of computer model outputs
journal, December 2002


A Bayesian approach for quantification of model uncertainty
journal, July 2010

  • Park, Inseok; Amarchinta, Hemanth K.; Grandhi, Ramana V.
  • Reliability Engineering & System Safety, Vol. 95, Issue 7
  • DOI: 10.1016/j.ress.2010.02.015

Control-variate estimation using estimated control means
journal, May 2012


Multifidelity importance sampling
journal, March 2016

  • Peherstorfer, Benjamin; Cui, Tiangang; Marzouk, Youssef
  • Computer Methods in Applied Mechanics and Engineering, Vol. 300
  • DOI: 10.1016/j.cma.2015.12.002

Dynamic data-driven reduced-order models
journal, July 2015

  • Peherstorfer, Benjamin; Willcox, Karen
  • Computer Methods in Applied Mechanics and Engineering, Vol. 291
  • DOI: 10.1016/j.cma.2015.03.018

Online Adaptive Model Reduction for Nonlinear Systems via Low-Rank Updates
journal, January 2015

  • Peherstorfer, Benjamin; Willcox, Karen
  • SIAM Journal on Scientific Computing, Vol. 37, Issue 4
  • DOI: 10.1137/140989169

Optimal Model Management for Multifidelity Monte Carlo Estimation
journal, January 2016

  • Peherstorfer, Benjamin; Willcox, Karen; Gunzburger, Max
  • SIAM Journal on Scientific Computing, Vol. 38, Issue 5
  • DOI: 10.1137/15M1046472

Development of a Multilevel Multidisciplinary-Optimization Capability for an Industrial Environment
journal, October 2013

  • Piperni, P.; DeBlois, A.; Henderson, R.
  • AIAA Journal, Vol. 51, Issue 10
  • DOI: 10.2514/1.J052180

Dynamic Mode Decomposition with Control
journal, January 2016

  • Proctor, Joshua L.; Brunton, Steven L.; Kutz, J. Nathan
  • SIAM Journal on Applied Dynamical Systems, Vol. 15, Issue 1
  • DOI: 10.1137/15M1013857

Surrogate-based analysis and optimization
journal, January 2005


A New Look at Proper Orthogonal Decomposition
journal, January 2003


Including model uncertainty in risk-informed decision making
journal, March 2006


Weak convergence and optimal scaling of random walk Metropolis algorithms
journal, February 1997

  • Roberts, G. O.; Gelman, A.; Gilks, W. R.
  • The Annals of Applied Probability, Vol. 7, Issue 1
  • DOI: 10.1214/aoap/1034625254

Coupling and Ergodicity of Adaptive Markov Chain Monte Carlo Algorithms
journal, June 2007

  • Roberts, Gareth O.; Rosenthal, Jeffrey S.
  • Journal of Applied Probability, Vol. 44, Issue 2
  • DOI: 10.1239/jap/1183667414

Surrogate-Based Optimization Using Multifidelity Models with Variable Parameterization and Corrected Space Mapping
journal, November 2008

  • Robinson, T. D.; Eldred, M. S.; Willcox, K. E.
  • AIAA Journal, Vol. 46, Issue 11
  • DOI: 10.2514/1.36043

Reduced basis approximation and a posteriori error estimation for Stokes flows in parametrized geometries: roles of the inf-sup stability constants
journal, March 2013

  • Rozza, Gianluigi; Huynh, D. B. Phuong; Manzoni, Andrea
  • Numerische Mathematik, Vol. 125, Issue 1
  • DOI: 10.1007/s00211-013-0534-8

On the stability of the reduced basis method for Stokes equations in parametrized domains
journal, January 2007

  • Rozza, Gianluigi; Veroy, Karen
  • Computer Methods in Applied Mechanics and Engineering, Vol. 196, Issue 7
  • DOI: 10.1016/j.cma.2006.09.005

GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
journal, July 1986

  • Saad, Youcef; Schultz, Martin H.
  • SIAM Journal on Scientific and Statistical Computing, Vol. 7, Issue 3
  • DOI: 10.1137/0907058

Design and Analysis of Computer Experiments
journal, November 1989

  • Sacks, Jerome; Welch, William J.; Mitchell, Toby J.
  • Statistical Science, Vol. 4, Issue 4
  • DOI: 10.1214/ss/1177012413

Nonlinear model reduction for dynamical systems using sparse sensor locations from learned libraries
journal, September 2015


Multi-fidelity robust aerodynamic design optimization under mixed uncertainty
journal, September 2015


Turbulence and the dynamics of coherent structures. I. Coherent structures
journal, January 1987

  • Sirovich, Lawrence
  • Quarterly of Applied Mathematics, Vol. 45, Issue 3
  • DOI: 10.1090/qam/910462

Inverse problems: A Bayesian perspective
journal, May 2010


Bayesian Guided Pattern Search for Robust Local Optimization
journal, November 2009

  • Taddy, Matthew A.; Lee, Herbert K. H.; Gray, Genetha A.
  • Technometrics, Vol. 51, Issue 4
  • DOI: 10.1198/TECH.2009.08007

A Multilevel Stochastic Collocation Method for Partial Differential Equations with Random Input Data
journal, January 2015

  • Teckentrup, A. L.; Jantsch, P.; Webster, C. G.
  • SIAM/ASA Journal on Uncertainty Quantification, Vol. 3, Issue 1
  • DOI: 10.1137/140969002

Further analysis of multilevel Monte Carlo methods for elliptic PDEs with random coefficients
journal, March 2013


Some adaptive Monte Carlo methods for Bayesian inference
journal, September 1999


Convergence Analysis for Anderson Acceleration
journal, January 2015

  • Toth, Alex; Kelley, C. T.
  • SIAM Journal on Numerical Analysis, Vol. 53, Issue 2
  • DOI: 10.1137/130919398

Using Supervised Learning to Improve Monte Carlo Integral Estimation
journal, August 2013

  • Tracey, Brendan; Wolpert, David; Alonso, Juan J.
  • AIAA Journal, Vol. 51, Issue 8
  • DOI: 10.2514/1.J051655

On dynamic mode decomposition: Theory and applications
journal, December 2014

  • Kutz, J. Nathan; Brunton, Steven L.; Luchtenburg, Dirk M.
  • Journal of Computational Dynamics, Vol. 1, Issue 2
  • DOI: 10.3934/jcd.2014.1.391

A new error bound for reduced basis approximation of parabolic partial differential equations
journal, February 2012


Construction of Response Surface Approximations for Design Optimization
journal, December 1998

  • Venter, Gerhard; Haftka, Raphael T.; Starnes, James H.
  • AIAA Journal, Vol. 36, Issue 12
  • DOI: 10.2514/2.333

Certified real-time solution of the parametrized steady incompressible Navier-Stokes equations: rigorous reduced-basisa posteriori error bounds
journal, January 2005

  • Veroy, K.; Patera, A. T.
  • International Journal for Numerical Methods in Fluids, Vol. 47, Issue 8-9
  • DOI: 10.1002/fld.867

A model and variance reduction method for computing statistical outputs of stochastic elliptic partial differential equations
journal, September 2015


Anderson Acceleration for Fixed-Point Iterations
journal, January 2011

  • Walker, Homer F.; Ni, Peng
  • SIAM Journal on Numerical Analysis, Vol. 49, Issue 4
  • DOI: 10.1137/10078356X

Global Convergence of Radial Basis Function Trust Region Derivative-Free Algorithms
journal, July 2011

  • Wild, Stefan M.; Shoemaker, Christine
  • SIAM Journal on Optimization, Vol. 21, Issue 3
  • DOI: 10.1137/09074927X

Combining Probability Distributions from Dependent Information Sources
journal, April 1981


Derivative-Enhanced Variable Fidelity Surrogate Modeling for Aerodynamic Functions
journal, January 2013

  • Yamazaki, Wataru; Mavriplis, Dimitri J.
  • AIAA Journal, Vol. 51, Issue 1
  • DOI: 10.2514/1.J051633

A Space-Time Petrov--Galerkin Certified Reduced Basis Method: Application to the Boussinesq Equations
journal, January 2014

  • Yano, Masayuki
  • SIAM Journal on Scientific Computing, Vol. 36, Issue 1
  • DOI: 10.1137/120903300

Accelerating Optimization of Parametric Linear Systems by Model Order Reduction
journal, January 2013

  • Yue, Yao; Meerbergen, Karl
  • SIAM Journal on Optimization, Vol. 23, Issue 2
  • DOI: 10.1137/120869171

Progressive construction of a parametric reduced-order model for PDE-constrained optimization: PDE-CONSTRAINED OPTIMIZATION USING A PROGRESSIVELY CONSTRUCTED ROM
journal, December 2014

  • Zahr, Matthew J.; Farhat, Charbel
  • International Journal for Numerical Methods in Engineering, Vol. 102, Issue 5
  • DOI: 10.1002/nme.4770

Two methods for the structured assessment of model uncertainty by experts in performance assessments of radioactive waste repositories
journal, November 1996


Statistical and Computational Inverse Problems
book, January 2005

  • Kaipio, Jari P.; Somersalo, Erkki
  • Applied Mathematical Sciences
  • DOI: 10.1007/b138659

Matrix formulation of co-kriging
journal, June 1982

  • Myers, Donald E.
  • Journal of the International Association for Mathematical Geology, Vol. 14, Issue 3
  • DOI: 10.1007/bf01032887

Reduced basis approximation and a posteriori error estimation for Stokes flows in parametrized geometries: roles of the inf-sup stability constants
journal, March 2013

  • Rozza, Gianluigi; Huynh, D. B. Phuong; Manzoni, Andrea
  • Numerische Mathematik, Vol. 125, Issue 1
  • DOI: 10.1007/s00211-013-0534-8

Hierarchical bases give conjugate gradient type methods a multigrid speed of convergence
journal, July 1986


Statistical inverse problems: Discretization, model reduction and inverse crimes
journal, January 2007

  • Kaipio, Jari; Somersalo, Erkki
  • Journal of Computational and Applied Mathematics, Vol. 198, Issue 2
  • DOI: 10.1016/j.cam.2005.09.027

On the stability of the reduced basis method for Stokes equations in parametrized domains
journal, January 2007

  • Rozza, Gianluigi; Veroy, Karen
  • Computer Methods in Applied Mechanics and Engineering, Vol. 196, Issue 7
  • DOI: 10.1016/j.cma.2006.09.005

A successive constraint linear optimization method for lower bounds of parametric coercivity and inf–sup stability constants
journal, October 2007


Optimal control of the cylinder wake in the laminar regime by trust-region methods and POD reduced-order models
journal, August 2008


Convergence Rates of the POD–Greedy Method
journal, April 2013

  • Haasdonk, Bernard
  • ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 47, Issue 3
  • DOI: 10.1051/m2an/2012045

Reduced basis method for finite volume approximations of parametrized linear evolution equations
journal, March 2008

  • Haasdonk, Bernard; Ohlberger, Mario
  • ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 42, Issue 2
  • DOI: 10.1051/m2an:2008001

Quantifying uncertainty in climate change science through empirical information theory
journal, August 2010

  • Majda, A. J.; Gershgorin, B.
  • Proceedings of the National Academy of Sciences, Vol. 107, Issue 34
  • DOI: 10.1073/pnas.1007009107

A Survey of Model Reduction by Balanced Truncation and Some New Results
journal, May 2004


A method for the solution of certain non-linear problems in least squares
journal, January 1944

  • Levenberg, Kenneth
  • Quarterly of Applied Mathematics, Vol. 2, Issue 2
  • DOI: 10.1090/qam/10666

The principle of minimized iterations in the solution of the matrix eigenvalue problem
journal, January 1951

  • Arnoldi, W. E.
  • Quarterly of Applied Mathematics, Vol. 9, Issue 1
  • DOI: 10.1090/qam/42792

Turbulence and the dynamics of coherent structures. II. Symmetries and transformations
journal, January 1987

  • Sirovich, Lawrence
  • Quarterly of Applied Mathematics, Vol. 45, Issue 3
  • DOI: 10.1090/qam/910463

Compensation of Modelling Errors Due to Unknown Domain Boundary in Electrical Impedance Tomography
journal, February 2011

  • Nissinen, A.; Kolehmainen, V. P.; Kaipio, J. P.
  • IEEE Transactions on Medical Imaging, Vol. 30, Issue 2
  • DOI: 10.1109/tmi.2010.2073716

Accurate Uncertainty Quantification Using Inaccurate Computational Models
journal, January 2009

  • Koutsourelakis, Phaedon-Stelios
  • SIAM Journal on Scientific Computing, Vol. 31, Issue 5
  • DOI: 10.1137/080733565

Nonlinear Model Reduction via Discrete Empirical Interpolation
journal, January 2010

  • Chaturantabut, Saifon; Sorensen, Danny C.
  • SIAM Journal on Scientific Computing, Vol. 32, Issue 5
  • DOI: 10.1137/090766498

Online Adaptive Model Reduction for Nonlinear Systems via Low-Rank Updates
journal, January 2015

  • Peherstorfer, Benjamin; Willcox, Karen
  • SIAM Journal on Scientific Computing, Vol. 37, Issue 4
  • DOI: 10.1137/140989169

On the Convergence of Pattern Search Algorithms
journal, February 1997


Iterative Procedures for Nonlinear Integral Equations
journal, October 1965


Corrections to linear methods for diffuse optical tomography using approximation error modelling
journal, January 2010

  • Tarvainen, Tanja; Kolehmainen, Ville; Kaipio, Jari P.
  • Biomedical Optics Express, Vol. 1, Issue 1
  • DOI: 10.1364/boe.1.000209

Principles of geostatistics
journal, December 1963


A variance reduction method for parametrized stochastic differential equations using the reduced basis paradigm
journal, January 2010

  • Boyaval, Sébastien; Lelièvre, Tony
  • Communications in Mathematical Sciences, Vol. 8, Issue 3
  • DOI: 10.4310/cms.2010.v8.n3.a7

Multi-Information Source Optimization
preprint, January 2016


Solution of systems of linear equations by minimized iterations
journal, July 1952

  • Lanczos, C.
  • Journal of Research of the National Bureau of Standards, Vol. 49, Issue 1
  • DOI: 10.6028/jres.049.006

Works referencing / citing this record:

Hierarchical top-down bottom-up calibration with consideration for uncertainty and inter-scale discrepancy of Peierls stress of bcc Fe
journal, June 2019

  • Tallman, Aaron E.; Swiler, Laura P.; Wang, Yan
  • Modelling and Simulation in Materials Science and Engineering, Vol. 27, Issue 6
  • DOI: 10.1088/1361-651x/ab23e4

A transport-based multifidelity preconditioner for Markov chain Monte Carlo
journal, November 2019


Optimization and uncertainty quantification of gradient index metasurfaces [Invited]
journal, January 2019

  • Schmitt, Nikolai; Georg, Niklas; Brière, Gauthier
  • Optical Materials Express, Vol. 9, Issue 2
  • DOI: 10.1364/ome.9.000892

Multifidelity Modeling by Polynomial Chaos-Based Cokriging to Enable Efficient Model-Based Reliability Analysis of NDT Systems
journal, January 2020


Multifidelity design guided by topology optimization
journal, November 2019

  • Yaji, Kentaro; Yamasaki, Shintaro; Fujita, Kikuo
  • Structural and Multidisciplinary Optimization, Vol. 61, Issue 3
  • DOI: 10.1007/s00158-019-02406-4

Lyapunov spectrum of forced homogeneous isotropic turbulent flows
journal, November 2019


Prediction and reduction of runtime in non-intrusive forward UQ simulations
journal, August 2019

  • Künzner, Florian; Neckel, Tobias; Bungartz, Hans-Joachim
  • SN Applied Sciences, Vol. 1, Issue 9
  • DOI: 10.1007/s42452-019-1066-3

Multiobjective Optimal Control Methods for the Navier-Stokes Equations Using Reduced Order Modeling
journal, August 2018

  • Peitz, Sebastian; Ober-Blöbaum, Sina; Dellnitz, Michael
  • Acta Applicandae Mathematicae, Vol. 161, Issue 1
  • DOI: 10.1007/s10440-018-0209-7

A new bi‐fidelity model reduction method for Bayesian inverse problems
journal, May 2019

  • Ou, Na; Jiang, Lijian; Lin, Guang
  • International Journal for Numerical Methods in Engineering, Vol. 119, Issue 10
  • DOI: 10.1002/nme.6079

Bayesian Estimation for Stochastic Gene Expression Using Multifidelity Models
journal, February 2019

  • Vo, Huy D.; Fox, Zachary; Baetica, Ania
  • The Journal of Physical Chemistry B, Vol. 123, Issue 10
  • DOI: 10.1021/acs.jpcb.8b10946

A transport-based multifidelity preconditioner for Markov chain Monte Carlo
preprint, January 2018


A transport-based multifidelity preconditioner for Markov chain Monte Carlo
journal, November 2019


Accelerating uncertainty quantification of groundwater flow modelling using a deep neural network proxy
journal, September 2021

  • Lykkegaard, Mikkel B.; Dodwell, Tim J.; Moxey, David
  • Computer Methods in Applied Mechanics and Engineering, Vol. 383
  • DOI: 10.1016/j.cma.2021.113895

Problem-fluent models for complex decision-making in autonomous materials research
journal, June 2021


Multifidelity probability estimation via fusion of estimators
journal, September 2019

  • Kramer, Boris; Marques, Alexandre Noll; Peherstorfer, Benjamin
  • Journal of Computational Physics, Vol. 392
  • DOI: 10.1016/j.jcp.2019.04.071

Using deep learning to extend the range of air pollution monitoring and forecasting
journal, May 2020

  • Hähnel, Philipp; Mareček, Jakub; Monteil, Julien
  • Journal of Computational Physics, Vol. 408
  • DOI: 10.1016/j.jcp.2020.109278

Multifidelity multilevel Monte Carlo to accelerate approximate Bayesian parameter inference for partially observed stochastic processes
journal, November 2022

  • Warne, David J.; Prescott, Thomas P.; Baker, Ruth E.
  • Journal of Computational Physics, Vol. 469
  • DOI: 10.1016/j.jcp.2022.111543

Harnessing Low-Fidelity Data to Accelerate Bayesian Optimization via Posterior Regularization
conference, February 2020


Gradient-Enhanced Multifidelity Neural Networks for High-Dimensional Function Approximation
conference, August 2021

  • Nagawkar, Jethro; Leifsson, Leifur
  • Volume 3B: 47th Design Automation Conference (DAC)
  • DOI: 10.1115/detc2021-70502

Multifidelity Approximate Bayesian Computation with Sequential Monte Carlo Parameter Sampling
journal, January 2021

  • Prescott, Thomas P.; Baker, Ruth E.
  • SIAM/ASA Journal on Uncertainty Quantification, Vol. 9, Issue 2
  • DOI: 10.1137/20m1316160

Context-Aware Surrogate Modeling for Balancing Approximation and Sampling Costs in Multifidelity Importance Sampling and Bayesian Inverse Problems
journal, March 2023

  • Alsup, Terrence; Peherstorfer, Benjamin
  • SIAM/ASA Journal on Uncertainty Quantification, Vol. 11, Issue 1
  • DOI: 10.1137/21m1445594

Smart energy models for atomistic simulations using a DFT-driven multifidelity approach
text, January 2018


IGA-based Multi-Index Stochastic Collocation for random PDEs on arbitrary domains
text, January 2018


Multifidelity Approximate Bayesian Computation
text, January 2018


Deep Gaussian Processes for Multi-fidelity Modeling
preprint, January 2019


Active Multi-Information Source Bayesian Quadrature
preprint, January 2019


Multilevel adaptive sparse Leja approximations for Bayesian inverse problems
text, January 2019


A Multi-level procedure for enhancing accuracy of machine learning algorithms
preprint, January 2019


Lyapunov spectrum of forced homogeneous isotropic turbulent flows
preprint, January 2019


Multi-Fidelity modeling of Probabilistic Aerodynamic Databases for Use in Aerospace Engineering
preprint, January 2019


Adaptive Sparse Polynomial Chaos Expansions via Leja Interpolation
preprint, January 2019


Multi-fidelity estimators for coronary circulation models under clinically-informed data uncertainty
preprint, January 2019


Numerical Linear Algebra in Data Assimilation
preprint, January 2019


Convergence Guarantees for Gaussian Process Means With Misspecified Likelihoods and Smoothness
preprint, January 2020


The Random Feature Model for Input-Output Maps between Banach Spaces
text, January 2020


Multi-Fidelity High-Order Gaussian Processes for Physical Simulation
preprint, January 2020


A Multifidelity Ensemble Kalman Filter with Reduced Order Control Variates
preprint, January 2020


Multi-Fidelity Bayesian Optimization via Deep Neural Networks
preprint, January 2020


Resource Aware Multifidelity Active Learning for Efficient Optimization
preprint, January 2020


Resource-Constrained Optimal Experimental Design
preprint, January 2020


Data-driven low-fidelity models for multi-fidelity Monte Carlo sampling in plasma micro-turbulence analysis
text, January 2021


Multilevel Stein variational gradient descent with applications to Bayesian inverse problems
preprint, January 2021