A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems
Abstract
Constructing surrogate models for uncertainty quantification (UQ) on complex partial differential equations (PDEs) having inherently high-dimensional O(10n), n ≥ 2, stochastic inputs (e.g., forcing terms, boundary conditions, initial conditions) poses tremendous challenges. The “curse of dimensionality” can be addressed with suitable unsupervised learning techniques used as a pre-processing tool to encode inputs onto lower-dimensional subspaces while retaining its structural information and meaningful properties. In this work, we review and investigate thirteen dimension reduction methods including linear and nonlinear, spectral, blind source separation, convex and non-convex methods and utilize the resulting embeddings to construct a mapping to quantities of interest via polynomial chaos expansions (PCE). Here, we refer to the general proposed approach as manifold PCE (m-PCE), where manifold corresponds to the latent space resulting from any of the studied dimension reduction methods. To investigate the capabilities and limitations of these methods we conduct numerical tests for three physics-based systems (treated as black-boxes) having high-dimensional stochastic inputs of varying complexity modeled as both Gaussian and non-Gaussian random fields to investigate the effect of the intrinsic dimensionality of input data. We demonstrate both the advantages and limitations of the unsupervised learning methods and we conclude that a suitable m-PCE model provides amore »
- Authors:
-
- Johns Hopkins Univ., Baltimore, MD (United States)
- Darmstadt Univ. of Technology (Germany); Siemens AG, Munich (Germany)
- Publication Date:
- Research Org.:
- Johns Hopkins Univ., Baltimore, MD (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
- OSTI Identifier:
- 1906444
- Alternate Identifier(s):
- OSTI ID: 1870935
- Grant/Contract Number:
- SC0020428
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Computational Physics
- Additional Journal Information:
- Journal Volume: 464; Journal ID: ISSN 0021-9991
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 42 ENGINEERING; 97 MATHEMATICS AND COMPUTING; High-dimensional uncertainty quantification; Dimension reduction; Unsupervised learning; Surrogate modeling; Manifold learning; Low-dimensional embedding
Citation Formats
Kontolati, Katiana, Loukrezis, Dimitrios, Giovanis, Dimitrios G., Vandanapu, Lohit, and Shields, Michael D. A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems. United States: N. p., 2022.
Web. doi:10.1016/j.jcp.2022.111313.
Kontolati, Katiana, Loukrezis, Dimitrios, Giovanis, Dimitrios G., Vandanapu, Lohit, & Shields, Michael D. A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems. United States. https://doi.org/10.1016/j.jcp.2022.111313
Kontolati, Katiana, Loukrezis, Dimitrios, Giovanis, Dimitrios G., Vandanapu, Lohit, and Shields, Michael D. Mon .
"A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems". United States. https://doi.org/10.1016/j.jcp.2022.111313. https://www.osti.gov/servlets/purl/1906444.
@article{osti_1906444,
title = {A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems},
author = {Kontolati, Katiana and Loukrezis, Dimitrios and Giovanis, Dimitrios G. and Vandanapu, Lohit and Shields, Michael D.},
abstractNote = {Constructing surrogate models for uncertainty quantification (UQ) on complex partial differential equations (PDEs) having inherently high-dimensional O(10n), n ≥ 2, stochastic inputs (e.g., forcing terms, boundary conditions, initial conditions) poses tremendous challenges. The “curse of dimensionality” can be addressed with suitable unsupervised learning techniques used as a pre-processing tool to encode inputs onto lower-dimensional subspaces while retaining its structural information and meaningful properties. In this work, we review and investigate thirteen dimension reduction methods including linear and nonlinear, spectral, blind source separation, convex and non-convex methods and utilize the resulting embeddings to construct a mapping to quantities of interest via polynomial chaos expansions (PCE). Here, we refer to the general proposed approach as manifold PCE (m-PCE), where manifold corresponds to the latent space resulting from any of the studied dimension reduction methods. To investigate the capabilities and limitations of these methods we conduct numerical tests for three physics-based systems (treated as black-boxes) having high-dimensional stochastic inputs of varying complexity modeled as both Gaussian and non-Gaussian random fields to investigate the effect of the intrinsic dimensionality of input data. We demonstrate both the advantages and limitations of the unsupervised learning methods and we conclude that a suitable m-PCE model provides a cost-effective approach compared to alternative algorithms proposed in the literature, including recently proposed expensive deep neural network-based surrogates and can be readily applied for high-dimensional UQ in stochastic PDEs.},
doi = {10.1016/j.jcp.2022.111313},
journal = {Journal of Computational Physics},
number = ,
volume = 464,
place = {United States},
year = {Mon May 23 00:00:00 EDT 2022},
month = {Mon May 23 00:00:00 EDT 2022}
}
Works referenced in this record:
Adaptive multi-element polynomial chaos with discrete measure: Algorithms and application to SPDEs
journal, April 2015
- Zheng, Mengdi; Wan, Xiaoliang; Karniadakis, George Em
- Applied Numerical Mathematics, Vol. 90
Sliced inverse regression-based sparse polynomial chaos expansions for reliability analysis in high dimensions
journal, November 2017
- Pan, Qiujing; Dias, Daniel
- Reliability Engineering & System Safety, Vol. 167
Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data
journal, October 2019
- Zhu, Yinhao; Zabaras, Nicholas; Koutsourelakis, Phaedon-Stelios
- Journal of Computational Physics, Vol. 394
ConvPDE-UQ: Convolutional neural networks with quantified uncertainty for heterogeneous elliptic partial differential equations on varied domains
journal, October 2019
- Winovich, Nick; Ramani, Karthik; Lin, Guang
- Journal of Computational Physics, Vol. 394
Fast and robust fixed-point algorithms for independent component analysis
journal, May 1999
- Hyvarinen, A.
- IEEE Transactions on Neural Networks, Vol. 10, Issue 3
Resampling Methods for Meta-Model Validation with Recommendations for Evolutionary Computation
journal, June 2012
- Bischl, B.; Mersmann, O.; Trautmann, H.
- Evolutionary Computation, Vol. 20, Issue 2
Simulation of Stationary Non-Gaussian Translation Processes
journal, February 1998
- Grigoriu, Mircea
- Journal of Engineering Mechanics, Vol. 124, Issue 2
Diffusion maps
journal, July 2006
- Coifman, Ronald R.; Lafon, Stéphane
- Applied and Computational Harmonic Analysis, Vol. 21, Issue 1
A Generalized Sampling and Preconditioning Scheme for Sparse Approximation of Polynomial Chaos Expansions
journal, January 2017
- Jakeman, John D.; Narayan, Akil; Zhou, Tao
- SIAM Journal on Scientific Computing, Vol. 39, Issue 3
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
journal, February 2019
- Raissi, M.; Perdikaris, P.; Karniadakis, G. E.
- Journal of Computational Physics, Vol. 378
Convergence study of the truncated Karhunen–Loeve expansion for simulation of stochastic processes
journal, November 2001
- Huang, S. P.; Quek, S. T.; Phoon, K. K.
- International Journal for Numerical Methods in Engineering, Vol. 52, Issue 9
Kernel PCA for novelty detection
journal, March 2007
- Hoffmann, Heiko
- Pattern Recognition, Vol. 40, Issue 3
PLS-based adaptation for efficient PCE representation in high dimensions
journal, June 2019
- Papaioannou, Iason; Ehre, Max; Straub, Daniel
- Journal of Computational Physics, Vol. 387
A generalized multi-fidelity simulation method using sparse polynomial chaos expansion
journal, December 2021
- Man, Jun; Lin, Guang; Yao, Yijun
- Journal of Computational and Applied Mathematics, Vol. 397
Adversarial uncertainty quantification in physics-informed neural networks
journal, October 2019
- Yang, Yibo; Perdikaris, Paris
- Journal of Computational Physics, Vol. 394
Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems
journal, July 2003
- Helton, J. C.; Davis, F. J.
- Reliability Engineering & System Safety, Vol. 81, Issue 1
A fast Fixed-Point Algorithm for Independent Component Analysis of Complex Valued Signals
journal, February 2000
- Bingham, Ella; HyvÄRinen, Aapo
- International Journal of Neural Systems, Vol. 10, Issue 01
Spectral Tensor-Train Decomposition
journal, January 2016
- Bigoni, Daniele; Engsig-Karup, Allan P.; Marzouk, Youssef M.
- SIAM Journal on Scientific Computing, Vol. 38, Issue 4
DPPro: Differentially Private High-Dimensional Data Release via Random Projection
journal, December 2017
- Xu, Chugui; Ren, Ju; Zhang, Yaoxue
- IEEE Transactions on Information Forensics and Security, Vol. 12, Issue 12
Multi-output local Gaussian process regression: Applications to uncertainty quantification
journal, July 2012
- Bilionis, Ilias; Zabaras, Nicholas
- Journal of Computational Physics, Vol. 231, Issue 17
Surrogate modeling of high-dimensional problems via data-driven polynomial chaos expansions and sparse partial least square
journal, June 2020
- Zhou, Yicheng; Lu, Zhenzhou; Hu, Jinghan
- Computer Methods in Applied Mechanics and Engineering, Vol. 364
Overview and comparative study of dimensionality reduction techniques for high dimensional data
journal, July 2020
- Ayesha, Shaeela; Hanif, Muhammad Kashif; Talib, Ramzan
- Information Fusion, Vol. 59
The generalization of Latin hypercube sampling
journal, April 2016
- Shields, Michael D.; Zhang, Jiaxin
- Reliability Engineering & System Safety, Vol. 148
Gaussian processes with built-in dimensionality reduction: Applications to high-dimensional uncertainty propagation
journal, September 2016
- Tripathy, Rohit; Bilionis, Ilias; Gonzalez, Marcial
- Journal of Computational Physics, Vol. 321
Reducing the Dimensionality of Data with Neural Networks
journal, July 2006
- Hinton, G. E.
- Science, Vol. 313, Issue 5786
Efficient Uncertainty Quantification for Unconfined Flow in Heterogeneous Media with the Sparse Polynomial Chaos Expansion
journal, December 2017
- Meng, Jin; Li, Heng
- Transport in Porous Media, Vol. 126, Issue 1
Active Manifold and Model-Order Reduction to Accelerate Multidisciplinary Analysis and Optimization
journal, November 2021
- Boncoraglio, Gabriele; Farhat, Charbel
- AIAA Journal, Vol. 59, Issue 11
Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
journal, November 2019
- Zhang, Dongkun; Lu, Lu; Guo, Ling
- Journal of Computational Physics, Vol. 397
Learning the parts of objects by non-negative matrix factorization
journal, October 1999
- Lee, Daniel D.; Seung, H. Sebastian
- Nature, Vol. 401, Issue 6755
Principal Manifolds and Nonlinear Dimensionality Reduction via Tangent Space Alignment
journal, January 2004
- Zhang, Zhenyue; Zha, Hongyuan
- SIAM Journal on Scientific Computing, Vol. 26, Issue 1
A Fast Fixed-Point Algorithm for Independent Component Analysis
journal, October 1997
- Hyvärinen, Aapo; Oja, Erkki
- Neural Computation, Vol. 9, Issue 7
Vector diffusion maps and the connection Laplacian
journal, March 2012
- Singer, A.; Wu, H. -T.
- Communications on Pure and Applied Mathematics, Vol. 65, Issue 8
Optimal Model Management for Multifidelity Monte Carlo Estimation
journal, January 2016
- Peherstorfer, Benjamin; Willcox, Karen; Gunzburger, Max
- SIAM Journal on Scientific Computing, Vol. 38, Issue 5
A comparative dimensionality reduction study in telecom customer segmentation using deep learning and PCA
journal, February 2020
- Alkhayrat, Maha; Aljnidi, Mohamad; Aljoumaa, Kadan
- Journal of Big Data, Vol. 7, Issue 1
Normalizing field flows: Solving forward and inverse stochastic differential equations using physics-informed flow models
journal, July 2022
- Guo, Ling; Wu, Hao; Zhou, Tao
- Journal of Computational Physics, Vol. 461
A survey on feature selection methods
journal, January 2014
- Chandrashekar, Girish; Sahin, Ferat
- Computers & Electrical Engineering, Vol. 40, Issue 1
Functional multi-layer perceptron: a non-linear tool for functional data analysis
journal, January 2005
- Rossi, Fabrice; Conan-Guez, Brieuc
- Neural Networks, Vol. 18, Issue 1
The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
journal, January 2002
- Xiu, Dongbin; Karniadakis, George Em
- SIAM Journal on Scientific Computing, Vol. 24, Issue 2
Non-intrusive low-rank separated approximation of high-dimensional stochastic models
journal, August 2013
- Doostan, Alireza; Validi, AbdoulAhad; Iaccarino, Gianluca
- Computer Methods in Applied Mechanics and Engineering, Vol. 263
Nonnegative Matrix Factorization: A Comprehensive Review
journal, June 2013
- Wang, Yu-Xiong; Zhang, Yu-Jin
- IEEE Transactions on Knowledge and Data Engineering, Vol. 25, Issue 6
Gradient-based optimization for regression in the functional tensor-train format
journal, December 2018
- Gorodetsky, Alex A.; Jakeman, John D.
- Journal of Computational Physics, Vol. 374
Polynomial Chaos in Stochastic Finite Elements
journal, March 1990
- Ghanem, Roger; Spanos, P. D.
- Journal of Applied Mechanics, Vol. 57, Issue 1
Reduced Wiener Chaos representation of random fields via basis adaptation and projection
journal, July 2017
- Tsilifis, Panagiotis; Ghanem, Roger G.
- Journal of Computational Physics, Vol. 341
Sparse representations and compressive sampling approaches in engineering mechanics: A review of theoretical concepts and diverse applications
journal, July 2020
- Kougioumtzoglou, Ioannis A.; Petromichelakis, Ioannis; Psaros, Apostolos F.
- Probabilistic Engineering Mechanics, Vol. 61
Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems
journal, July 1995
- Tianping Chen,
- IEEE Transactions on Neural Networks, Vol. 6, Issue 4
Extending Classical Surrogate Modeling to high Dimensions Through Supervised Dimensionality Reduction: a Data-Driven Approach
journal, January 2020
- Lataniotis, Christos; Marelli, Stefano; Sudret, Bruno
- International Journal for Uncertainty Quantification, Vol. 10, Issue 1
Independent component analysis: algorithms and applications
journal, June 2000
- Hyvärinen, A.; Oja, E.
- Neural Networks, Vol. 13, Issue 4-5
Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators
journal, March 2021
- Lu, Lu; Jin, Pengzhan; Pang, Guofei
- Nature Machine Intelligence, Vol. 3, Issue 3
A gradient enhanced ℓ1-minimization for sparse approximation of polynomial chaos expansions
journal, August 2018
- Guo, Ling; Narayan, Akil; Zhou, Tao
- Journal of Computational Physics, Vol. 367
Grassmannian Diffusion Maps--Based Dimension Reduction and Classification for High-Dimensional Data
journal, March 2022
- dos Santos, Ketson R.; Giovanis, Dimitrios G.; Shields, Michael D.
- SIAM Journal on Scientific Computing, Vol. 44, Issue 2
An efficient stochastic approach for flow in porous media via sparse polynomial chaos expansion constructed by feature selection
journal, July 2017
- Meng, Jin; Li, Heng
- Advances in Water Resources, Vol. 105
Manifold learning for coarse-graining atomistic simulations: Application to amorphous solids
journal, August 2021
- Kontolati, Katiana; Alix-Williams, Darius; Boffi, Nicholas M.
- Acta Materialia, Vol. 215
Quantifying uncertain system outputs via the multilevel Monte Carlo method — Part I: Central moment estimation
journal, August 2020
- Krumscheid, S.; Nobile, F.; Pisaroni, M.
- Journal of Computational Physics, Vol. 414
Solving parametric PDE problems with artificial neural networks
journal, July 2020
- Khoo, Yuehaw; Lu, Jianfeng; Ying, Lexing
- European Journal of Applied Mathematics, Vol. 32, Issue 3
An efficient multifidelity -minimization method for sparse polynomial chaos
journal, June 2018
- Salehi, Saeed; Raisee, Mehrdad; Cervantes, Michel J.
- Computer Methods in Applied Mechanics and Engineering, Vol. 334
Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification
journal, December 2018
- Tripathy, Rohit K.; Bilionis, Ilias
- Journal of Computational Physics, Vol. 375
Sparse Legendre expansions via <mml:math altimg="si12.gif" display="inline" overflow="scroll" xmlns:xocs="http://www.elsevier.com/xml/xocs/dtd" xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://www.elsevier.com/xml/ja/dtd" xmlns:ja="http://www.elsevier.com/xml/ja/dtd" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:tb="http://www.elsevier.com/xml/common/table/dtd" xmlns:sb="http://www.elsevier.com/xml/common/struct-bib/dtd" xmlns:ce="http://www.elsevier.com/xml/common/dtd" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:cals="http://www.elsevier.com/xml/common/cals/dtd"><mml:msub><mml:mrow><mml:mi>ℓ</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:math>-minimization
journal, May 2012
- Rauhut, Holger; Ward, Rachel
- Journal of Approximation Theory, Vol. 164, Issue 5
A note on two problems in connexion with graphs
journal, December 1959
- Dijkstra, E. W.
- Numerische Mathematik, Vol. 1, Issue 1
A Global Geometric Framework for Nonlinear Dimensionality Reduction
journal, December 2000
- Tenenbaum, J. B.
- Science, Vol. 290, Issue 5500
Algorithm 97: Shortest path
journal, June 1962
- Floyd, Robert W.
- Communications of the ACM, Vol. 5, Issue 6
Bayesian deep convolutional encoder–decoder networks for surrogate modeling and uncertainty quantification
journal, August 2018
- Zhu, Yinhao; Zabaras, Nicholas
- Journal of Computational Physics, Vol. 366
A Multilinear Singular Value Decomposition
journal, January 2000
- De Lathauwer, Lieven; De Moor, Bart; Vandewalle, Joos
- SIAM Journal on Matrix Analysis and Applications, Vol. 21, Issue 4
Surrogate modeling of advanced computer simulations using deep Gaussian processes
journal, March 2020
- Radaideh, Majdi I.; Kozlowski, Tomasz
- Reliability Engineering & System Safety, Vol. 195
Past review, current progress, and challenges ahead on the cocktail party problem
journal, January 2018
- Qian, Yan-min; Weng, Chao; Chang, Xuan-kai
- Frontiers of Information Technology & Electronic Engineering, Vol. 19, Issue 1
Compressive sensing adaptation for polynomial chaos expansions
journal, March 2019
- Tsilifis, Panagiotis; Huan, Xun; Safta, Cosmin
- Journal of Computational Physics, Vol. 380
Remarks on a Multivariate Transformation
journal, September 1952
- Rosenblatt, Murray
- The Annals of Mathematical Statistics, Vol. 23, Issue 3
A generalized approximate control variate framework for multifidelity uncertainty quantification
journal, May 2020
- Gorodetsky, Alex A.; Geraci, Gianluca; Eldred, Michael S.
- Journal of Computational Physics, Vol. 408
Robust adaptive least squares polynomial chaos expansions in high‐frequency applications
journal, February 2020
- Loukrezis, Dimitrios; Galetzka, Armin; De Gersem, Herbert
- International Journal of Numerical Modelling: Electronic Networks, Devices and Fields, Vol. 33, Issue 6
Advances in surrogate based modeling, feasibility analysis, and optimization: A review
journal, January 2018
- Bhosekar, Atharv; Ierapetritou, Marianthi
- Computers & Chemical Engineering, Vol. 108
Adaptive sparse polynomial chaos expansion based on least angle regression
journal, March 2011
- Blatman, Géraud; Sudret, Bruno
- Journal of Computational Physics, Vol. 230, Issue 6
Data-driven uncertainty quantification using the arbitrary polynomial chaos expansion
journal, October 2012
- Oladyshkin, S.; Nowak, W.
- Reliability Engineering & System Safety, Vol. 106
Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data
journal, April 2003
- Donoho, D. L.; Grimes, C.
- Proceedings of the National Academy of Sciences, Vol. 100, Issue 10
Numerical Gaussian Processes for Time-Dependent and Nonlinear Partial Differential Equations
journal, January 2018
- Raissi, Maziar; Perdikaris, Paris; Karniadakis, George Em
- SIAM Journal on Scientific Computing, Vol. 40, Issue 1
Integrated stochastic analysis of fiber composites manufacturing using adapted polynomial chaos expansions
journal, March 2019
- Ghauch, Ziad G.; Aitharaju, Venkat; Rodgers, William R.
- Composites Part A: Applied Science and Manufacturing, Vol. 118
Accelerated basis adaptation in homogeneous chaos spaces
journal, December 2021
- Zeng, Xiaoshu; Red-Horse, John; Ghanem, Roger
- Computer Methods in Applied Mechanics and Engineering, Vol. 386
Exploiting active subspaces to quantify uncertainty in the numerical simulation of the HyShot II scramjet
journal, December 2015
- Constantine, P. G.; Emory, M.; Larsson, J.
- Journal of Computational Physics, Vol. 302
Random-projection ensemble classification
journal, June 2017
- Cannings, Timothy I.; Samworth, Richard J.
- Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 79, Issue 4
Nonlinear Dimensionality Reduction by Locally Linear Embedding
journal, December 2000
- Roweis, S. T.
- Science, Vol. 290, Issue 5500
Basis adaptation in homogeneous chaos spaces
journal, February 2014
- Tipireddy, Ramakrishna; Ghanem, Roger
- Journal of Computational Physics, Vol. 259
A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code
journal, February 2000
- Mckay, M. D.; Beckman, R. J.; Conover, W. J.
- Technometrics, Vol. 42, Issue 1
Uncertainty propagation using infinite mixture of Gaussian processes and variational Bayesian inference
journal, March 2015
- Chen, Peng; Zabaras, Nicholas; Bilionis, Ilias
- Journal of Computational Physics, Vol. 284
An adaptive algorithm to build up sparse polynomial chaos expansions for stochastic finite element analysis
journal, April 2010
- Blatman, Géraud; Sudret, Bruno
- Probabilistic Engineering Mechanics, Vol. 25, Issue 2
Data-driven polynomial chaos expansion for machine learning regression
journal, July 2019
- Torre, Emiliano; Marelli, Stefano; Embrechts, Paul
- Journal of Computational Physics, Vol. 388
Basis adaptive sample efficient polynomial chaos (BASE-PC)
journal, October 2018
- Hampton, Jerrad; Doostan, Alireza
- Journal of Computational Physics, Vol. 371
Beyond Wiener–Askey Expansions: Handling Arbitrary PDFs
journal, December 2005
- Wan, Xiaoliang; Karniadakis, George Em
- Journal of Scientific Computing, Vol. 27, Issue 1-3
Quasi-Monte Carlo and Multilevel Monte Carlo Methods for Computing Posterior Expectations in Elliptic Inverse Problems
journal, January 2017
- Scheichl, R.; Stuart, A. M.; Teckentrup, A. L.
- SIAM/ASA Journal on Uncertainty Quantification, Vol. 5, Issue 1
Data-driven surrogates for high dimensional models using Gaussian process regression on the Grassmann manifold
journal, October 2020
- Giovanis, D. G.; Shields, M. D.
- Computer Methods in Applied Mechanics and Engineering, Vol. 370
Diffusion maps and coarse-graining: a unified framework for dimensionality reduction, graph partitioning, and data set parameterization
journal, September 2006
- Lafon, S.; Lee, A. B.
- IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, Issue 9, p. 1393-1403
Artificial neural networks for solving ordinary and partial differential equations
journal, January 1998
- Lagaris, I. E.; Likas, A.; Fotiadis, D. I.
- IEEE Transactions on Neural Networks, Vol. 9, Issue 5
Reliability analysis of high-dimensional models using low-rank tensor approximations
journal, October 2016
- Konakli, Katerina; Sudret, Bruno
- Probabilistic Engineering Mechanics, Vol. 46
Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values
journal, June 1994
- Paatero, Pentti; Tapper, Unto
- Environmetrics, Vol. 5, Issue 2
Importance sampling: a review
journal, December 2009
- Tokdar, Surya T.; Kass, Robert E.
- WIREs Computational Statistics, Vol. 2, Issue 1
Bayesian neural networks for uncertainty quantification in data-driven materials modeling
journal, December 2021
- Olivier, Audrey; Shields, Michael D.; Graham-Brady, Lori
- Computer Methods in Applied Mechanics and Engineering, Vol. 386
A hybrid neural network-first principles approach to process modeling
journal, October 1992
- Psichogios, Dimitris C.; Ungar, Lyle H.
- AIChE Journal, Vol. 38, Issue 10
Sparse Polynomial Chaos Expansions: Literature Survey and Benchmark
journal, January 2021
- Lüthen, Nora; Marelli, Stefano; Sudret, Bruno
- SIAM/ASA Journal on Uncertainty Quantification, Vol. 9, Issue 2
Homogeneous chaos basis adaptation for design optimization under uncertainty: Application to the oil well placement problem
journal, August 2017
- Thimmisetty, Charanraj; Tsilifis, Panagiotis; Ghanem, Roger
- Artificial Intelligence for Engineering Design, Analysis and Manufacturing, Vol. 31, Issue 3
Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
journal, June 2003
- Belkin, Mikhail; Niyogi, Partha
- Neural Computation, Vol. 15, Issue 6
An adaptive polynomial chaos expansion for high-dimensional reliability analysis
journal, July 2020
- He, Wanxin; Zeng, Yan; Li, Gang
- Structural and Multidisciplinary Optimization, Vol. 62, Issue 4
Aleatory or epistemic? Does it matter?
journal, March 2009
- Kiureghian, Armen Der; Ditlevsen, Ove
- Structural Safety, Vol. 31, Issue 2
UQpy: A general purpose Python package and development environment for uncertainty quantification
journal, November 2020
- Olivier, Audrey; Giovanis, Dimitris G.; Aakash, B. S.
- Journal of Computational Science, Vol. 47
Simulation of Multi-Dimensional Gaussian Stochastic Fields by Spectral Representation
journal, January 1996
- Shinozuka, Masanobu; Deodatis, George
- Applied Mechanics Reviews, Vol. 49, Issue 1
Physical Systems with Random Uncertainties: Chaos Representations with Arbitrary Probability Measure
journal, January 2004
- Soize, Christian; Ghanem, Roger
- SIAM Journal on Scientific Computing, Vol. 26, Issue 2
Least angle and ℓ1 penalized regression: A review
journal, January 2008
- Hesterberg, Tim; Choi, Nam Hee; Meier, Lukas
- Statistics Surveys, Vol. 2, Issue none
The Earth Mover's Distance as a Metric for Image Retrieval
journal, November 2000
- Rubner, Yossi
- International Journal of Computer Vision, Vol. 40, Issue 2, p. 99-121
Deep learning for high-dimensional reliability analysis
journal, May 2020
- Li, Mingyang; Wang, Zequn
- Mechanical Systems and Signal Processing, Vol. 139
Learning in high-dimensional multimedia data: the state of the art
journal, October 2015
- Gao, Lianli; Song, Jingkuan; Liu, Xingyi
- Multimedia Systems, Vol. 23, Issue 3