DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: PyApprox: A software package for sensitivity analysis, Bayesian inference, optimal experimental design, and multi-fidelity uncertainty quantification and surrogate modeling

Journal Article · · Environmental Modelling and Software

PyApprox is a Python-based one-stop-shop for probabilistic analysis of numerical models such as those used in the earth, environmental and engineering sciences. Easy to use and extendable tools are provided for constructing surrogates, sensitivity analysis, Bayesian inference, experimental design, and forward uncertainty quantification. The algorithms implemented represent a wide range of methods for model analysis developed over the past two decades, including recent advances in multi-fidelity approaches that use multiple model discretizations and/or simplified physics to significantly reduce the computational cost of various types of analyses. An extensive set of Benchmarks from the literature is also provided to facilitate the easy comparison of new or existing algorithms for a wide range of model analyses. Here, this paper introduces PyApprox and its various features, and presents results demonstrating the utility of PyApprox on a benchmark problem modeling the advection of a tracer in groundwater.

Research Organization:
Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Biological and Environmental Research (BER); Defense Advanced Research Projects Agency (DARPA); USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR). Scientific Discovery through Advanced Computing (SciDAC); USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
NA0003525
OSTI ID:
2311280
Report Number(s):
SAND--2023-13522J
Journal Information:
Environmental Modelling and Software, Journal Name: Environmental Modelling and Software Journal Issue: 1 Vol. 170; ISSN 1364-8152
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (85)

Adaptive experimental design for multi‐fidelity surrogate modeling of multi‐disciplinary systems
  • Jakeman, John D.; Friedman, Sam; Eldred, Michael S.
  • International Journal for Numerical Methods in Engineering, Vol. 123, Issue 12 https://doi.org/10.1002/nme.6958
journal March 2022
Optimum Experimental Design book January 2011
Error estimates and condition numbers for radial basis function interpolation journal April 1995
MFNets: data efficient all-at-once learning of multifidelity surrogates as directed networks of information sources journal August 2021
Dimension?Adaptive Tensor?Product Quadrature journal August 2003
DRAM: Efficient adaptive MCMC journal December 2006
Multivariate distribution models with prescribed marginals and covariances journal June 1986
Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates journal February 2001
A Python surrogate modeling framework with derivatives journal September 2019
Numerical methods for the discretization of random fields by means of the Karhunen–Loève expansion journal April 2014
Multi-Index Stochastic Collocation for random PDEs journal July 2016
A continuous analogue of the tensor-train decomposition journal April 2019
Polynomial chaos expansions for dependent random variables journal July 2019
UncertainSCI: Uncertainty quantification for computational models in biomedicine and bioengineering journal January 2023
Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index journal February 2010
Watershed model parameter estimation and uncertainty in data-limited environments journal January 2014
A GUI platform for uncertainty quantification of complex dynamical models journal February 2016
Uncertainty analysis of a semi-distributed hydrologic model based on a Gaussian Process emulator journal March 2018
VARS-TOOL: A toolbox for comprehensive, efficient, and robust sensitivity and uncertainty analysis journal February 2019
Introductory overview of identifiability analysis: A guide to evaluating whether you have the right type of data for your modeling purpose journal September 2019
A non-intrusive approach for efficient stochastic emulation and optimization of model-based nitrate-loading management decision support journal April 2020
The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support journal March 2021
Multifidelity prediction in wildfire spread simulation: Modeling, uncertainty quantification and sensitivity analysis journal July 2021
A surrogate model for efficient quantification of uncertainties in multilayer shallow water flows journal October 2021
Sensitivity analysis: A discipline coming of age journal December 2021
Enabling dynamic emulation of high-dimensional model outputs: Demonstration for Mexico City groundwater management journal January 2022
Global sensitivity analysis in hydrodynamic modeling and flood inundation mapping journal June 2022
An interactive graphical interface tool for parameter calibration, sensitivity analysis, uncertainty analysis, and visualization for the Soil and Water Assessment Tool journal October 2022
Stochastic spectral methods for efficient Bayesian solution of inverse problems journal June 2007
Numerical approach for quantification of epistemic uncertainty journal June 2010
Adaptive sparse polynomial chaos expansion based on least angle regression journal March 2011
Simulation-based optimal Bayesian experimental design for nonlinear systems journal January 2013
Enhancing ℓ 1 -minimization estimates of polynomial chaos expansions using basis selection journal May 2015
Scalable and efficient algorithms for the propagation of uncertainty from data through inference to prediction for large-scale problems, with application to flow of the Antarctic ice sheet journal September 2015
Gradient-based optimization for regression in the functional tensor-train format journal December 2018
A generalized approximate control variate framework for multifidelity uncertainty quantification journal May 2020
On the optimization of approximate control variates with parametrically defined estimators journal February 2022
Chaospy: An open source tool for designing methods of uncertainty quantification journal November 2015
UQpy: A general purpose Python package and development environment for uncertainty quantification journal November 2020
Global sensitivity analysis using polynomial chaos expansions journal July 2008
Global sensitivity analysis using sparse grid interpolation and polynomial chaos journal November 2012
Construction of bootstrap confidence intervals on sensitivity indices computed by polynomial chaos expansion journal January 2014
Surrogate modeling for efficiently, accurately and conservatively estimating measures of risk journal May 2022
Pygpc: A sensitivity and uncertainty analysis toolbox for Python journal January 2020
Kernel techniques: From machine learning to meshless methods journal May 2006
Inverse problems: A Bayesian perspective journal May 2010
Multilevel Monte Carlo methods journal April 2015
Factorial Sampling Plans for Preliminary Computational Experiments journal May 1991
Two-Stage Sensitivity-Based Group Screening in Computer Experiments journal November 2012
A Christoffel function weighted least squares algorithm for collocation approximations journal November 2016
Predicting the output from a complex computer code when fast approximations are available journal March 2000
Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit journal December 2007
Probabilistic sensitivity analysis of complex models: a Bayesian approach journal August 2004
Sequential Monte Carlo samplers journal June 2006
A Common Rationale for Global Sensitivity Measures and Their Estimation: A Common Rationale for Global Sensitivity Measures journal February 2016
A Sparse Grid Stochastic Collocation Method for Partial Differential Equations with Random Input Data journal January 2008
Unified Hybridization of Discontinuous Galerkin, Mixed, and Continuous Galerkin Methods for Second Order Elliptic Problems journal January 2009
Adaptive Smolyak Pseudospectral Approximations journal January 2013
A Computational Framework for Infinite-Dimensional Bayesian Inverse Problems, Part II: Stochastic Newton MCMC with Application to Ice Sheet Flow Inverse Problems journal January 2014
Adaptive Leja Sparse Grid Constructions for Stochastic Collocation and High-Dimensional Approximation journal January 2014
A Multilevel Stochastic Collocation Method for Partial Differential Equations with Random Input Data journal January 2015
Optimal Model Management for Multifidelity Monte Carlo Estimation journal January 2016
A Generalized Sampling and Preconditioning Scheme for Sparse Approximation of Polynomial Chaos Expansions journal January 2017
Adaptive Approximation by Optimal Weighted Least-Squares Methods journal January 2019
On Multilevel Best Linear Unbiased Estimators journal January 2020
Risk-Adapted Optimal Experimental Design journal June 2022
On the Convergence of Adaptive Stochastic Collocation for Elliptic Partial Differential Equations with Affine Diffusion journal March 2022
Adjoint Sensitivity Analysis for Differential-Algebraic Equations: The Adjoint DAE System and Its Numerical Solution journal January 2003
The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations journal January 2002
hIPPYlib: An Extensible Software Framework for Large-Scale Inverse Problems Governed by PDEs: Part I: Deterministic Inversion and Linearized Bayesian Inference journal April 2021
Algorithm 247: Radical-inverse quasi-random point sequence journal December 1964
Remark on algorithm 659: Implementing Sobol's quasirandom sequence generator journal March 2003
Estimating Expected Information Gains for Experimental Designs With Application to the Random Fatigue-Limit Model journal September 2003
Least angle regression journal April 2004
Remarks on a Multivariate Transformation journal September 1952
Accelerating Markov Chain Monte Carlo Simulation by Differential Evolution with Self-Adaptive Randomized Subspace Sampling journal January 2009
Computation of induced orthogonal polynomial distributions journal January 2018
Recursive Co-Kriging Model for Design of Computer Experiments with Multiple Levels of Fidelity journal January 2014
SALib: An open-source Python library for Sensitivity Analysis journal January 2017
scikit-fem: A Python package for finite element assembly journal August 2020
MUQ: The MIT Uncertainty Quantification Library journal December 2021
Adaptive sparse grids journal April 2003
Building Efficient Response Surfaces of Aerodynamic Functions with Kriging and Cokriging journal February 2008
Cholesky-Based Experimental Design for Gaussian Process and Kernel-Based Emulation and Calibration journal February 2021
SymPy: symbolic computing in Python journal January 2017