Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

GenMod: A generative modeling approach for spectral representation of PDEs with random inputs

Journal Article · · Journal of Computational Physics
 [1];  [1]
  1. Univ. of Colorado, Boulder, CO (United States)
Here, we propose a method for quantifying uncertainty in high-dimensional PDE systems with random parameters, where the number of solution evaluations is small. Parametric PDE solutions are often approximated using a spectral decomposition based on polynomial chaos expansions. For the class of systems we consider (i.e., high dimensional with limited solution evaluations) the coefficients are given by an underdetermined linear system in a regression formulation. This implies additional assumptions, such as sparsity of the coefficient vector, are needed to approximate the solution. Here, we present an approach where we assume the coefficients are close to the range of a generative model that maps from a low to a high dimensional space of coefficients. Our approach is inspired be recent work examining how generative models can be used for compressed sensing in systems with random Gaussian measurement matrices. Using results from PDE theory on coefficient decay rates, we construct an explicit generative model that predicts the polynomial chaos coefficient magnitudes. The algorithm we developed to find the coefficients, which we call GenMod, is composed of two main steps. First, we predict the coefficient signs using Orthogonal Matching Pursuit. Then, we assume the coefficients are within a sparse deviation from the range of a sign-adjusted generative model. This allows us to find the coefficients by solving a nonconvex optimization problem, over the input space of the generative model and the space of sparse vectors. We obtain theoretical recovery results for a Lipschitz continuous generative model and for a more specific generative model, based on coefficient decay rate bounds. We examine three high-dimensional problems and show that, for all three examples, the generative model approach outperforms sparsity promoting methods at small sample sizes.
Research Organization:
Univ. of Colorado, Boulder, CO (United States)
Sponsoring Organization:
US Air Force Office of Scientific Research (AFOSR); USDOE; USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
NA0003962
OSTI ID:
2417951
Alternate ID(s):
OSTI ID: 1896327
OSTI ID: 2997176
Journal Information:
Journal of Computational Physics, Journal Name: Journal of Computational Physics Journal Issue: C Vol. 472; ISSN 0021-9991
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (26)

Stable signal recovery from incomplete and inaccurate measurements
  • Candès, Emmanuel J.; Romberg, Justin K.; Tao, Terence
  • Communications on Pure and Applied Mathematics, Vol. 59, Issue 8, p. 1207-1223 https://doi.org/10.1002/cpa.20124
journal January 2006
Convergence study of the truncated Karhunen–Loeve expansion for simulation of stochastic processes journal November 2001
A Stochastic Projection Method for Fluid Flow journal September 2002
Enhancing Sparsity by Reweighted ℓ 1 Minimization journal October 2008
Analysis of quasi-optimal polynomial approximations for parameterized PDEs with deterministic and stochastic coefficients journal March 2017
Convergence Rates of Best N-term Galerkin Approximations for a Class of Elliptic sPDEs journal July 2010
Modeling uncertainty in flow simulations via generalized polynomial chaos journal May 2003
Coherence motivated sampling and convergence analysis of least squares polynomial Chaos regression journal June 2015
Sparse Legendre expansions via ℓ1-minimization journal May 2012
A non-adapted sparse approximation of PDEs with stochastic inputs journal April 2011
Reweighted minimization method for stochastic elliptic differential equations journal September 2013
A weighted -minimization approach for sparse polynomial chaos expansions journal June 2014
A low-rank control variate for multilevel Monte Carlo simulation of high-dimensional uncertain systems journal July 2017
Basis adaptive sample efficient polynomial chaos (BASE-PC) journal October 2018
Practical error bounds for a non-intrusive bi-fidelity approach to parametric/stochastic model reduction journal September 2018
Compressed sensing and best $k$-term approximation journal July 2008
Polynomial approximation via compressed sensing of high-dimensional functions on lower sets journal September 2017
Application of the Karhunen-Loève Expansion to Feature Selection and Ordering journal April 1970
Model-Based Compressive Sensing journal April 2010
Regression Shrinkage and Selection Via the Lasso journal January 1996
New and Improved Johnson–Lindenstrauss Embeddings via the Restricted Isometry Property journal January 2011
The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations journal January 2002
On the Optimal Polynomial Approximation of Stochastic pdes by Galerkin and Collocation Methods journal July 2012
Generative adversarial networks journal October 2020
Simultaneous analysis of Lasso and Dantzig selector journal August 2009
The Homogeneous Chaos journal October 1938

Similar Records

A mixed $\ell_1$ regularization approach for sparse simultaneous approximation of parameterized PDEs
Journal Article · Wed Jun 26 20:00:00 EDT 2019 · Mathematical Modelling and Numerical Analysis · OSTI ID:1564178

A data-driven framework for sparsity-enhanced surrogates with arbitrary mutually dependent randomness
Journal Article · Sat Jun 15 00:00:00 EDT 2019 · Computer Methods in Applied Mechanics and Engineering · OSTI ID:1543272