Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Non-intrusive reduced order modeling of natural convection in porous media using convolutional autoencoders: Comparison with linear subspace techniques

Journal Article · · Advances in Water Resources
 [1];  [2];  [3];  [4];  [5];  [6]
  1. Cornell Univ., Ithaca, NY (United States); Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
  2. Catholic University of the Sacred Heart, Brescia (Italy)
  3. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
  4. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
  5. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
  6. Cornell Univ., Ithaca, NY (United States)
Natural convection in porous media is a highly nonlinear multiphysical problem relevant to many engineering applications (e.g., the process of CO2 sequestration). Here, we extend and present a non-intrusive reduced order model of natural convection in porous media employing deep convolutional autoencoders for the compression and reconstruction and either radial basis function (RBF) interpolation or artificial neural networks (ANNs) for mapping parameters of partial differential equations (PDEs) on the corresponding nonlinear manifolds. To benchmark our approach, we also describe linear compression and reconstruction processes relying on proper orthogonal decomposition (POD) and ANNs. Further, we present comprehensive comparisons among different models through three benchmark problems. The reduced order models, linear and nonlinear approaches, are much faster than the finite element model, obtaining a maximum speed-up of 7 × 106 because our framework is not bound by the Courant–Friedrichs–Lewy condition; hence, it could deliver quantities of interest at any given time contrary to the finite element model. Our model’s accuracy still lies within a relative error of 7% in the worst-case scenario. We illustrate that, in specific settings, the nonlinear approach outperforms its linear counterpart and vice versa. We hypothesize that a visual comparison between principal component analysis (PCA) and t-Distributed Stochastic Neighbor Embedding (t-SNE) could indicate which method will perform better prior to employing any specific compression strategy.
Research Organization:
Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States); Los Alamos National Laboratory (LANL), Los Alamos, NM (United States); Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
European Research Council (ERC); Horizon 2020 Program; USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
89233218CNA000001; AC52-07NA27344; NA0003525
OSTI ID:
1842833
Alternate ID(s):
OSTI ID: 1843127
OSTI ID: 1884759
Report Number(s):
LA-UR-21-26841; LLNL-JRNL--824706; SAND--2022-0981J; 703131
Journal Information:
Advances in Water Resources, Journal Name: Advances in Water Resources Vol. 160; ISSN 0309-1708
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (62)

Scaling behavior of convective mixing, with application to geological storage of CO2 journal January 2007
Non-intrusive reduced-order modelling of the Navier-Stokes equations based on RBF interpolation: Non-intrusive reduced-order modelling of the Navier-Stokes equations based on RBF interpolation journal July 2015
Model identification of reduced order fluid dynamics systems using deep learning: Model identification in fluid dynamics using deep learning journal August 2017
Reduced-order modeling of parameterized PDEs using time-space-parameter principal component analysis journal November 2009
An adaptive and efficient greedy procedure for the optimal training of parametric reduced-order models: ADAPTIVE GREEDY PROCEDURE FOR THE OPTIMAL TRAINING OF PARAMETRIC ROMS journal September 2014
A POD-selective inverse distance weighting method for fast parametrized shape morphing: A POD-selective IDW method for fast parametrized shape morphing
  • Ballarin, Francesco; D'Amario, Alessandro; Perotto, Simona
  • International Journal for Numerical Methods in Engineering, Vol. 117, Issue 8 https://doi.org/10.1002/nme.5982
journal November 2018
Nonintrusive reduced-order modeling of parametrized time-dependent partial differential equations journal February 2013
Principal component analysis: Principal component analysis journal June 2010
Proper Orthogonal Decomposition and its Applications—Part i: Theory journal May 2002
Design optimization using hyper-reduced-order models journal November 2014
Efficient approximation of solutions of parametric linear transport equations by ReLU DNNs journal January 2021
A Weighted POD Method for Elliptic PDEs with Random Inputs journal September 2018
A Comprehensive Deep Learning-Based Approach to Reduced Order Modeling of Nonlinear Time-Dependent Parametrized PDEs journal April 2021
Data-driven reduced order modeling of poroelasticity of heterogeneous media based on a discontinuous Galerkin approximation journal June 2021
Finite element modelling of recirculating density-driven saltwater intrusion processes in groundwater journal March 1988
Numerical modelling of convection dominated transport coupled with density driven flow in porous media journal October 2000
Variable-density flow and transport in porous media: approaches and challenges journal August 2002
Theoretical analysis of the worthiness of Henry and Elder problems as benchmarks of density-dependent groundwater flow models journal January 2003
Coupled groundwater flow and transport: 1. Verification of variable density flow and transport models journal February 1998
Automatic early stopping using cross validation: quantifying the criteria journal June 1998
Numerical modeling of density-driven solute transport in fractured porous media with the extended finite element method journal February 2020
Upscaling capillary pressure curves for numerical modeling of gravity-capillary driven flow journal August 2020
A mixed finite element solver for natural convection in porous media using automated solution techniques journal November 2016
A locally conservative mixed finite element framework for coupled hydro-mechanical–chemical processes in heterogeneous porous media journal July 2021
Continuous block backward differentiation formula for solving stiff ordinary differential equations journal April 2013
Data-driven reduced order modeling for time-dependent problems journal March 2019
Component-wise reduced order model lattice-type structure design journal August 2021
Reduced order models for Lagrangian hydrodynamics journal January 2022
A domain decomposition non-intrusive reduced order model for turbulent flows journal March 2019
A numerical study of THM effects on the near-field safety of a hypothetical nuclear waste repository—BMT1 of the DECOVALEX III project. Part 3: Effects of THM coupling in sparsely fractured rocks journal July 2005
Thermal–hydrologic–mechanical–chemical processes in the evolution of engineered geothermal reservoirs journal July 2009
Reactive dispersive contaminant transport in coastal aquifers: Numerical simulation of a reactive Henry problem journal February 2013
Reduced order models based on local POD plus Galerkin projection journal April 2010
Fast simulations of patient-specific haemodynamics of coronary artery bypass grafts based on a POD–Galerkin method and a vascular shape parametrization journal June 2016
Non-intrusive reduced order modeling of nonlinear problems using neural networks journal June 2018
Conservative model reduction for finite-volume models journal October 2018
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations journal February 2019
Non-intrusive reduced order modeling of unsteady flows using artificial neural networks with application to a combustion problem journal May 2019
Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders journal November 2019
Gradient-based constrained optimization using a database of linear reduced-order models journal December 2020
Space–time reduced order model for large-scale linear dynamical systems with application to Boltzmann transport problems journal January 2021
A review of indirect/non-intrusive reduced order modeling of nonlinear geometric structures journal May 2013
Transient convection in a porous medium journal February 1967
Convective dissolution of carbon dioxide in saline aquifers: CONVECTIVE DISSOLUTION OF CARBON DIOXIDE journal November 2010
Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators journal March 2021
Assessment of unsteady flow predictions using hybrid deep learning based reduced-order models journal January 2021
Quantum autoencoders for efficient compression of quantum data journal August 2017
Data Compression Using Adaptive Coding and Partial String Matching journal January 1984
A Locally Conservative Finite Element Method Based on Piecewise Constant Enrichment of the Continuous Galerkin Method journal January 2009
A Locally Conservative Enriched Galerkin Approximation and Efficient Solver for Elliptic and Parabolic Problems journal January 2016
Hierarchical Approximate Proper Orthogonal Decomposition journal January 2018
Space--Time Least-Squares Petrov--Galerkin Projection for Nonlinear Model Reduction journal January 2019
Phase-Field Modeling of Two Phase Fluid Filled Fractures in a Poroelastic Medium journal January 2018
SNS: A Solution-Based Nonlinear Subspace Method for Time-Dependent Model Order Reduction journal January 2020
An Artificial Compression Reduced Order Model journal January 2020
Extracting and composing robust features with denoising autoencoders conference January 2008
On the Partial Difference Equations of Mathematical Physics journal March 1967
Physics-informed neural networks for solving nonlinear diffusivity and Biot’s equations journal May 2020
Balanced Model Reduction via the Proper Orthogonal Decomposition journal November 2002
Non-Intrusive Inference Reduced Order Model for Fluids Using Deep Multistep Neural Network journal August 2019
Extended Physics-Informed Neural Networks (XPINNs): A Generalized Space-Time Domain Decomposition Based Deep Learning Framework for Nonlinear Partial Differential Equations journal June 2020
Upscaling capillary pressure curves for numerical modeling of gravity-capillary driven flow dataset January 2020

Cited By (1)