Optimal experimental design: Formulations and computations
- University of Michigan, Ann Arbor, MI (United States); University of Michigan
- Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
- Massachusetts Institute of Technology (MIT), Cambridge, MA (United States)
Questions of ‘how best to acquire data’ are essential to modelling and prediction in the natural and social sciences, engineering applications, and beyond. Optimal experimental design (OED) formalizes these questions and creates computational methods to answer them. This article presents a systematic survey of modern OED, from its foundations in classical design theory to current research involving OED for complex models. We begin by reviewing criteria used to formulate an OED problem and thus to encode the goal of performing an experiment. We emphasize the flexibility of the Bayesian and decision-theoretic approach, which encompasses information-based criteria that are well-suited to nonlinear and non-Gaussian statistical models. We then discuss methods for estimating or bounding the values of these design criteria; this endeavour can be quite challenging due to strong nonlinearities, high parameter dimension, large per-sample costs, or settings where the model is implicit. A complementary set of computational issues involves optimization methods used to find a design; we discuss such methods in the discrete (combinatorial) setting of observation selection and in settings where an exact design can be continuously parametrized. Finally we present emerging methods for sequential OED that build non-myopic design policies, rather than explicit designs; these methods naturally adapt to the outcomes of past experiments in proposing new experiments, while seeking coordination among all experiments to be performed. Throughout, we highlight important open questions and challenges.
- Research Organization:
- University of Michigan, Ann Arbor, MI (United States)
- Sponsoring Organization:
- Air Force Office of Scientific Research (AFOSR); Office of Naval Research (ONR); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
- Grant/Contract Number:
- AC52-07NA27344; SC0021226; SC0021397; SC0021398; SC0023187; SC0023188
- OSTI ID:
- 2440515
- Alternate ID(s):
- OSTI ID: 2440696
- Journal Information:
- Acta Numerica, Journal Name: Acta Numerica Vol. 33; ISSN 0962-4929
- Publisher:
- Cambridge University PressCopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Practical and Optimal Sequential Bayesian Experimental Design for Complex Systems Incorporating Human Experimenter Preferences (Final Scientific/Technical Report)
A Scalable Gradient Free Method for Bayesian Experimental Design with Implicit Models
Technical Report
·
Wed Dec 25 23:00:00 EST 2024
·
OSTI ID:2483855
A Scalable Gradient Free Method for Bayesian Experimental Design with Implicit Models
Conference
·
Thu Apr 01 00:00:00 EDT 2021
·
OSTI ID:1784117