skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Physics-Informed Machine Learning with Conditional Karhunen-Loève Expansions

Journal Article · · Journal of Computational Physics

We present a new physics-informed machine learning approach for the inversion of PDE models with heterogeneous parameters. In our approach, the space-dependent partially-observed parameters and states are approximated via Karhunen-Lo\`eve expansions (KLEs). Each of these KLEs is then conditioned on their corresponding measurements, resulting in low-dimensional models of the parameters and states that resolve observed data. Finally, the coefficients of the KLEs are estimated by minimizing the norm of the residual of the PDE model evaluated at a finite set of points in the computational domain, ensuring that the reconstructed parameters and states are consistent with both the observations and the PDE model to an arbitrary level of accuracy. In our approach, KLEs are constructed using the eigendecomposition of covariance models of spatial variability. For the model parameters, we employ a parameterized covariance model calibrated on parameter observations; for the model states, the covariance is estimated from a number of forward simulations of the PDE model corresponding to realizations of the parameters drawn from their KLE. We apply the proposed approach to identifying heterogeneous log-diffusion coefficients in diffusion equations from spatially sparse measurements of the log-diffusion coefficient and the solution of the diffusion equation. We find that the proposed approach compares favorably against state-of-the-art point estimates such as maximum a posteriori estimation and physics-informed neural networks.

Research Organization:
Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
Sponsoring Organization:
USDOE
DOE Contract Number:
AC05-76RL01830
OSTI ID:
1765120
Report Number(s):
PNNL-SA-149882
Journal Information:
Journal of Computational Physics, Vol. 426
Country of Publication:
United States
Language:
English

References (38)

Inverse Modeling of Subsurface Flow and Transport Properties: A Review with New Developments journal May 2008
Efficient Bayesian inference of subsurface flow models using nested sampling and sparse polynomial chaos surrogates journal February 2014
Convergence rates for Tikhonov regularisation of non-linear ill-posed problems journal August 1989
Inverse problems: A Bayesian perspective journal May 2010
An efficient Bayesian inference approach to inverse problems based on an adaptive sparse grid collocation method journal February 2009
Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems journal April 2009
Maximum a posteriori estimates in linear inverse problems with log-concave priors are proper Bayes estimators journal October 2014
Linear functional minimization for inverse modeling: LINEAR FUNCTIONAL MINIMIZATION FOR INVERSE MODELING journal June 2015
Ground Water Model Calibration Using Pilot Points and Regularization journal March 2003
Pilot points method incorporating prior information for solving the groundwater flow inverse problem journal November 2006
Pilot Point Methodology for Automated Calibration of an Ensemble of conditionally Simulated Transmissivity Fields: 1. Theory and Computational Experiments journal March 1995
The origins of kriging journal April 1990
Gappy data: To Krig or not to Krig? journal February 2006
Application of ensemble-based data assimilation techniques for aquifer characterization using tracer data at Hanford 300 area: Tracer Data Assimilation at Hanford 300 Area journal October 2013
Ensemble Kalman filter data assimilation for a process-based catchment scale model of surface and subsurface flow: EnKF FOR A MODEL OF SURFACE AND SUBSURFACE FLOW journal October 2009
Analysis of the Ensemble Kalman Filter for Inverse Problems journal January 2017
Simultaneous identification of a contaminant source and hydraulic conductivity via the restart normal-score ensemble Kalman filter journal February 2018
Recent developments in hydrologic data assimilation journal July 1995
Physics-informed CoKriging: A Gaussian-process-regression-based multifidelity method for data-model convergence journal October 2019
Approximate Bayesian model inversion for PDEs with heterogeneous and state-dependent coefficients journal October 2019
Geometric MCMC for infinite-dimensional inverse problems journal April 2017
Physics‐Informed Deep Neural Networks for Learning Parameters and Constitutive Relationships in Subsurface Flow Problems journal May 2020
Conditional Karhunen-Loève expansion for uncertainty quantification and active learning in partial differential equation models journal October 2020
Convergence study of the truncated Karhunen–Loeve expansion for simulation of stochastic processes journal November 2001
Stochastic Finite Element Expansion for Random Media journal May 1989
Multilevel Monte Carlo methods journal April 2015
A Comparison of Closures for Stochastic Advection-Diffusion Equations journal January 2013
Unsaturated flow in heterogeneous soils with spatially distributed uncertain hydraulic parameters journal May 2003
Fine scale uncertainty in parameter estimation for elliptic equations journal November 2009
Discrete Adjoint Sensitivity Analysis of Hybrid Dynamical Systems With Switching journal May 2017
Algorithm Developments for Discrete Adjoint Methods journal February 2003
Coordinate transformation and Polynomial Chaos for the Bayesian inference of a Gaussian process with parametrized prior covariance function journal January 2016
A Chebyshev polynomial-based Galerkin method for the discretization of spatially varying random properties journal February 2017
Karhunen–Loève approximation of random fields by generalized fast multipole methods journal September 2006
Application of hierarchical matrices for computing the Karhunen–Loève expansion journal October 2008
Python for Scientific Computing journal January 2007
Conditioning Truncated Pluri-Gaussian Models to Facies Observations in Ensemble-Kalman-Based Data Assimilation journal April 2014
Hierarchical Bayesian level set inversion journal September 2016