Vecchia-Approximated Deep Gaussian Processes for Computer Experiments

Sauer, Annie; Cooper, Andrew; Gramacy, Robert B.

doi:10.1080/10618600.2022.2129662

Vecchia-Approximated Deep Gaussian Processes for Computer Experiments

Journal Article · 08 November 2022 · Journal of Computational and Graphical Statistics

DOI:https://doi.org/10.1080/10618600.2022.2129662· OSTI ID:2424711

Sauer, Annie ^[1]; Cooper, Andrew ^[1]; Gramacy, Robert B. ^[1]

Department of Statistics, Virginia Tech, Blacksburg, VA

Not provided.

Research Organization:: US Department of Energy (USDOE), Washington, DC (United States). Office of Science, Advanced Scientific Computing Research (ASCR)

Sponsoring Organization:: USDOE

OSTI ID:: 2424711

Journal Information:: Journal of Computational and Graphical Statistics, Journal Name: Journal of Computational and Graphical Statistics Journal Issue: 3 Vol. 32; ISSN 1061-8600

Publisher:: Taylor & Francis

Country of Publication:: United States

Language:: English

References (54)

Deep Compositional Spatial Models Zammit-Mangion, Andrew; Ng, Tin Lok James; Vu, Quan Journal of the American Statistical Association, Vol. 117, Issue 540 https://doi.org/10.1080/01621459.2021.1887741	journal	April 2021
Microstructure reconstruction and structural equation modeling for computational design of nanodielectrics Zhang, Yichi; Zhao, He; Hassinger, Irene Integrating Materials and Manufacturing Innovation, Vol. 4, Issue 1 https://doi.org/10.1186/s40192-015-0043-y	journal	December 2015
Emulating Satellite Drag from Large Simulation Experiments Sun, Furong; Gramacy, Robert B.; Haaland, Benjamin SIAM/ASA Journal on Uncertainty Quantification, Vol. 7, Issue 2 https://doi.org/10.1137/18M1170157	journal	January 2019
Microcolony and biofilm formation as a survival strategy for bacteria Johnson, Leah R. Journal of Theoretical Biology, Vol. 251, Issue 1 https://doi.org/10.1016/j.jtbi.2007.10.039	journal	March 2008
Gaussian Process Regression With Automatic Relevance Determination Kernel for Calendar Aging Prediction of Lithium-Ion Batteries Liu, Kailong; Li, Yi; Hu, Xiaosong IEEE Transactions on Industrial Informatics, Vol. 16, Issue 6 https://doi.org/10.1109/TII.2019.2941747	journal	June 2020
RcppArmadillo: Accelerating R with high-performance C++ linear algebra Eddelbuettel, Dirk; Sanderson, Conrad Computational Statistics & Data Analysis, Vol. 71 https://doi.org/10.1016/j.csda.2013.02.005	journal	March 2014
Local Gaussian Process Approximation for Large Computer Experiments Gramacy, Robert B.; Apley, Daniel W. Journal of Computational and Graphical Statistics, Vol. 24, Issue 2 https://doi.org/10.1080/10618600.2014.914442	journal	April 2015
Monte Carlo sampling methods using Markov chains and their applications Hastings, W. K. Biometrika, Vol. 57, Issue 1 https://doi.org/10.1093/biomet/57.1.97	journal	April 1970
Active Learning for Deep Gaussian Process Surrogates Sauer, Annie; Gramacy, Robert B.; Higdon, David Technometrics, Vol. 65, Issue 1 https://doi.org/10.1080/00401706.2021.2008505	journal	February 2022
Analyzing Nonstationary Spatial Data Using Piecewise Gaussian Processes Kim, Hyoung-Moon; Mallick, Bani K.; Holmes, C. C. Journal of the American Statistical Association, Vol. 100, Issue 470 https://doi.org/10.1198/016214504000002014	journal	June 2005
A Case Study Competition Among Methods for Analyzing Large Spatial Data Heaton, Matthew J.; Datta, Abhirup; Finley, Andrew O. Journal of Agricultural, Biological and Environmental Statistics, Vol. 24, Issue 3 https://doi.org/10.1007/s13253-018-00348-w	journal	December 2018
Modeling satellite drag coefficients with response surfaces Mehta, Piyush M.; Walker, Andrew; Lawrence, Earl Advances in Space Research, Vol. 54, Issue 8 https://doi.org/10.1016/j.asr.2014.06.033	journal	October 2014
Deep Gaussian Processes for Calibration of Computer Models (with Discussion) Marmin, Sébastien; Filippone, Maurizio Bayesian Analysis, Vol. 17, Issue 4 https://doi.org/10.1214/21-BA1293	journal	December 2022
Aerodynamic Characteristics and Glide-Back Performance of Langley Glide-Back Booster Pamadi, Bandu; Covell, Peter; Tartabini, Paul 22nd Applied Aerodynamics Conference and Exhibit https://doi.org/10.2514/6.2004-5382	conference	June 2004
Bayesian Data Analysis Gelman, Andrew; Carlin, John B.; Stern, Hal S. https://doi.org/10.1201/b16018	book	November 2013
spNNGP R Package for Nearest Neighbor Gaussian Process Models Finley, Andrew O.; Datta, Abhirup; Banerjee, Sudipto Journal of Statistical Software, Vol. 103, Issue 5 https://doi.org/10.18637/jss.v103.i05	journal	January 2022
Bayesian Treed Gaussian Process Models With an Application to Computer Modeling Gramacy, Robert B.; Lee, Herbert K. H. Journal of the American Statistical Association, Vol. 103, Issue 483 https://doi.org/10.1198/016214508000000689	journal	September 2008
Deep Gaussian Process autoencoders for novelty detection Domingues, Rémi; Michiardi, Pietro; Zouaoui, Jihane Machine Learning, Vol. 107, Issue 8-10 https://doi.org/10.1007/s10994-018-5723-3	journal	June 2018
A General Framework for Vecchia Approximations of Gaussian Processes Katzfuss, Matthias; Guinness, Joseph Statistical Science, Vol. 36, Issue 1 https://doi.org/10.1214/19-STS755	journal	February 2021
Replication or Exploration? Sequential Design for Stochastic Simulation Experiments Binois, Mickaël; Huang, Jiangeng; Gramacy, Robert B. Technometrics, Vol. 61, Issue 1 https://doi.org/10.1080/00401706.2018.1469433	journal	September 2018
Calculations of Sobol indices for the Gaussian process metamodel Marrel, Amandine; Iooss, Bertrand; Laurent, Béatrice Reliability Engineering & System Safety, Vol. 94, Issue 3 https://doi.org/10.1016/j.ress.2008.07.008	journal	March 2009
Linked Gaussian Process Emulation for Systems of Computer Models Using Matérn Kernels and Adaptive Design Ming, Deyu; Guillas, Serge SIAM/ASA Journal on Uncertainty Quantification, Vol. 9, Issue 4 https://doi.org/10.1137/20M1323771	journal	January 2021
When Gaussian Process Meets Big Data: A Review of Scalable GPs Liu, Haitao; Ong, Yew-Soon; Shen, Xiaobo IEEE Transactions on Neural Networks and Learning Systems, Vol. 31, Issue 11 https://doi.org/10.1109/TNNLS.2019.2957109	journal	November 2020
Bayesian inference for non-stationary spatial covariance structure via spatial deformations: Bayesian Inference for Non-stationary Spatial Covariance Structure Schmidt, Alexandra M.; O'Hagan, Anthony Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 65, Issue 3 https://doi.org/10.1111/1467-9868.00413	journal	July 2003
The kriging update equations and their application to the selection of neighboring data Emery, Xavier Computational Geosciences, Vol. 13, Issue 3 https://doi.org/10.1007/s10596-008-9116-8	journal	October 2008
Dimension Reduction for Gaussian Process Emulation: An Application to the Influence of Bathymetry on Tsunami Heights Liu, Xiaoyu; Guillas, Serge SIAM/ASA Journal on Uncertainty Quantification, Vol. 5, Issue 1 https://doi.org/10.1137/16M1090648	journal	January 2017
Gaussian Processes for Machine Learning Rasmussen, Carl Edward; Williams, Christopher K. I. The MIT Press https://doi.org/10.7551/mitpress/3206.001.0001	book	January 2005
Gaussian predictive process models for large spatial data sets Banerjee, Sudipto; Gelfand, Alan E.; Finley, Andrew O. Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 70, Issue 4 https://doi.org/10.1111/j.1467-9868.2008.00663.x	journal	September 2008
Improving the performance of predictive process modeling for large datasets Finley, Andrew O.; Sang, Huiyan; Banerjee, Sudipto Computational Statistics & Data Analysis, Vol. 53, Issue 8 https://doi.org/10.1016/j.csda.2008.09.008	journal	June 2009
Vecchia Approximations of Gaussian-Process Predictions Katzfuss, Matthias; Guinness, Joseph; Gong, Wenlong Journal of Agricultural, Biological and Environmental Statistics, Vol. 25, Issue 3 https://doi.org/10.1007/s13253-020-00401-7	journal	June 2020
Bayesian and Maximum Likelihood Estimation for Gaussian Processes on an Incomplete Lattice Stroud, Jonathan R.; Stein, Michael L.; Lysen, Shaun Journal of Computational and Graphical Statistics, Vol. 26, Issue 1 https://doi.org/10.1080/10618600.2016.1152970	journal	January 2017
Vps: Voronoi Piecewise Surrogate Models for High-Dimensional data Fitting Rushdi, Ahmad A.; Swiler, Laura P.; Phipps, Eric T. International Journal for Uncertainty Quantification, Vol. 7, Issue 1 https://doi.org/10.1615/Int.J.UncertaintyQuantification.2016018697	journal	January 2017
Interpolation of Spatial Data Stein, Michael L. Springer Series in Statistics https://doi.org/10.1007/978-1-4612-1494-6	book	January 1999
Efficient emulators of computer experiments using compactly supported correlation functions, with an application to cosmology Kaufman, Cari G.; Bingham, Derek; Habib, Salman The Annals of Applied Statistics, Vol. 5, Issue 4 https://doi.org/10.1214/11-AOAS489	journal	December 2011
Empirical Assessment of Deep Gaussian Process Surrogate Models for Engineering Problems Rajaram, Dushhyanth; Puranik, Tejas G.; Ashwin Renganathan, S. Journal of Aircraft, Vol. 58, Issue 1 https://doi.org/10.2514/1.C036026	journal	January 2021
Analyzing Stochastic Computer Models: A Review with Opportunities Baker, Evan; Barbillon, Pierre; Fadikar, Arindam Statistical Science, Vol. 37, Issue 1 https://doi.org/10.1214/21-STS822	journal	February 2022
Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geostatistical Datasets Datta, Abhirup; Banerjee, Sudipto; Finley, Andrew O. Journal of the American Statistical Association, Vol. 111, Issue 514 https://doi.org/10.1080/01621459.2015.1044091	journal	April 2016
Bayesian calibration of computer models Kennedy, Marc C.; O'Hagan, Anthony Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 63, Issue 3 https://doi.org/10.1111/1467-9868.00294	journal	August 2001
Permutation and Grouping Methods for Sharpening Gaussian Process Approximations Guinness, Joseph Technometrics, Vol. 60, Issue 4 https://doi.org/10.1080/00401706.2018.1437476	journal	June 2018
Nonparametric Estimation of Nonstationary Spatial Covariance Structure Sampson, Paul D.; Guttorp, Peter Journal of the American Statistical Association, Vol. 87, Issue 417 https://doi.org/10.1080/01621459.1992.10475181	journal	March 1992
A Nonstationary Space-Time Gaussian Process Model for Partially Converged Simulations Picheny, Victor; Ginsbourger, David SIAM/ASA Journal on Uncertainty Quantification, Vol. 1, Issue 1 https://doi.org/10.1137/120882834	journal	January 2013
Efficient Global Optimization of Expensive Black-Box Functions Jones, Donald R.; Schonlau, Matthias; Welch, William J. Journal of Global Optimization, Vol. 13, Issue 4, p. 455-492 https://doi.org/10.1023/A:1008306431147	journal	January 1998
Efficient Deep Gaussian Process Models for Variable-Sized Inputs Laradji, Issam H.; Schmidt, Mark; Pavlovic, Vladimir 2019 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2019.8851768	conference	July 2019
Uncertainty quantification of a computer model for binary black hole formation Lin, Luyao; Bingham, Derek; Broekgaarden, Floor The Annals of Applied Statistics, Vol. 15, Issue 4 https://doi.org/10.1214/21-AOAS1484	journal	December 2021
Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code McKay, M. D.; Beckman, R. J.; Conover, W. J. Technometrics, Vol. 21, Issue 2 https://doi.org/10.1080/00401706.1979.10489755	journal	May 1979
Locally induced Gaussian processes for large-scale simulation experiments Cole, D. Austin; Christianson, Ryan B.; Gramacy, Robert B. Statistics and Computing, Vol. 31, Issue 3 https://doi.org/10.1007/s11222-021-10007-9	journal	April 2021
Knot selection in sparse Gaussian processes with a variational objective function Garton, Nathaniel; Niemi, Jarad; Carriquiry, Alicia Statistical Analysis and Data Mining: The ASA Data Science Journal, Vol. 13, Issue 4 https://doi.org/10.1002/sam.11459	journal	April 2020
Surrogates Gramacy, Robert B. https://doi.org/10.1201/9780367815493	book	January 2020
Strictly Proper Scoring Rules, Prediction, and Estimation Gneiting, Tilmann; Raftery, Adrian E. Journal of the American Statistical Association, Vol. 102, Issue 477 https://doi.org/10.1198/016214506000001437	journal	March 2007
Efficient Algorithms for Bayesian Nearest Neighbor Gaussian Processes Finley, Andrew O.; Datta, Abhirup; Cook, Bruce D. Journal of Computational and Graphical Statistics, Vol. 28, Issue 2 https://doi.org/10.1080/10618600.2018.1537924	journal	April 2019
Estimation and Model Identification for Continuous Spatial Processes Vecchia, A. V. Journal of the Royal Statistical Society: Series B (Methodological), Vol. 50, Issue 2 https://doi.org/10.1111/j.2517-6161.1988.tb01729.x	journal	January 1988
Gaussian process learning via Fisher scoring of Vecchia’s approximation Guinness, Joseph Statistics and Computing, Vol. 31, Issue 3 https://doi.org/10.1007/s11222-021-09999-1	journal	March 2021
Practical Heteroscedastic Gaussian Process Modeling for Large Simulation Experiments Binois, Mickaël; Gramacy, Robert B.; Ludkovski, Mike Journal of Computational and Graphical Statistics, Vol. 27, Issue 4 https://doi.org/10.1080/10618600.2018.1458625	journal	July 2018
Approximating likelihoods for large spatial data sets Stein, Michael L.; Chi, Zhiyi; Welty, Leah J. Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 66, Issue 2 https://doi.org/10.1046/j.1369-7412.2003.05512.x	journal	May 2004

Similar Records

Scaled Vecchia Approximation for Fast Computer-Model Emulation

Journal Article · 2022 · SIAM/ASA Journal on Uncertainty Quantification · OSTI ID:1994113

Surrogate modeling of advanced computer simulations using deep Gaussian processes

Journal Article · 2020 · Reliability Engineering and System Safety · OSTI ID:1801255

Active Learning for Deep Gaussian Process Surrogates

Journal Article · 2022 · Technometrics · OSTI ID:2424686

Related Subjects

Mathematics

Vecchia-Approximated Deep Gaussian Processes for Computer Experiments

Citation Formats

References (54)

Similar Records

Related Subjects