DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A physics-informed and hierarchically regularized data-driven model for predicting fluid flow through porous media

Abstract

This paper presents a new deep learning data-driven model for predicting structure dependent pore-fluid velocity fields in rock. The model is based on a Convolutional Auto-Encoder (CAE) artificial neural network capable of learning from image data generated by direct numerical simulations of fluid flow through pore-structures, such as by Lattice Boltzmann or molecular dynamics methods. The main novelty of the model in comparison to previous CAE-based data-driven approaches consists of three parts. The first is a methodology for decomposing the full-domain of the porous media into sub-regions, or “sub-domains”, in order to reduce the overall size of the CAE, batch process the sub-domains in parallel, and enable the CAE to learn local and generalizable nonlinear mappings of pore-fluid velocities. The second consists of embedding the finite difference solutions of the incompressible Navier-Stokes and continuity equations into convolutional layers prior to the CAE in order to provide the CAE with knowledge of fluid dynamics physics (PhyFlow). The third main novelty is that the training of the CAE is regularized with a hierarchical loss function that encourages the learning of fluid flow patterns (in a way similar to ranked modes in principal component analysis), ranking from most to least important. This ismore » shown to increase the stability in learning, reduce over-fitting, and promote interpretability of the CAE neural network layers (HierCAE). The comprehensive new data-driven model, which we call the PhyFlow-HierCAE model, is shown to exhibit improved accuracy and generalizability of flow field predictions over conventional CAE models, attributable to the embedded physical knowledge and the hierarchical regularization, as well as realize orders of magnitude speed-ups in computation times as a surrogate for the direct numerical simulations. Examples of training and forward predictions on unseen pore-structures are provided and evaluated for data from Lattice Boltzmann and molecular dynamics simulations of pore-fluid flow. The model is shown to be a fast and accurate emulator (or “surrogate”) for predicting effective permeability of unseen pore-structures based on learning from relatively small direct numerical simulation datasets.« less

Authors:
ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]
  1. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Publication Date:
Research Org.:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1804349
Alternate Identifier(s):
OSTI ID: 1815191
Report Number(s):
LA-UR-20-27444
Journal ID: ISSN 0021-9991; TRN: US2212271
Grant/Contract Number:  
89233218CNA000001; 20190005DR
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Computational Physics
Additional Journal Information:
Journal Volume: 443; Journal ID: ISSN 0021-9991
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS; Porous Media; Deep Learning; Permeability; Machine learning; CAE; Porous flow; Shale; Lattice Boltzmann; Molecular dynamics

Citation Formats

Wang, Kun, Chen, Yu, Mehana, Mohamed Zakaria Saad, Lubbers, Nicholas Edward, Bennett, Kane, Kang, Qinjun, Viswanathan, Hari S., and Germann, Timothy Clark. A physics-informed and hierarchically regularized data-driven model for predicting fluid flow through porous media. United States: N. p., 2021. Web. doi:10.1016/j.jcp.2021.110526.
Wang, Kun, Chen, Yu, Mehana, Mohamed Zakaria Saad, Lubbers, Nicholas Edward, Bennett, Kane, Kang, Qinjun, Viswanathan, Hari S., & Germann, Timothy Clark. A physics-informed and hierarchically regularized data-driven model for predicting fluid flow through porous media. United States. https://doi.org/10.1016/j.jcp.2021.110526
Wang, Kun, Chen, Yu, Mehana, Mohamed Zakaria Saad, Lubbers, Nicholas Edward, Bennett, Kane, Kang, Qinjun, Viswanathan, Hari S., and Germann, Timothy Clark. Fri . "A physics-informed and hierarchically regularized data-driven model for predicting fluid flow through porous media". United States. https://doi.org/10.1016/j.jcp.2021.110526. https://www.osti.gov/servlets/purl/1804349.
@article{osti_1804349,
title = {A physics-informed and hierarchically regularized data-driven model for predicting fluid flow through porous media},
author = {Wang, Kun and Chen, Yu and Mehana, Mohamed Zakaria Saad and Lubbers, Nicholas Edward and Bennett, Kane and Kang, Qinjun and Viswanathan, Hari S. and Germann, Timothy Clark},
abstractNote = {This paper presents a new deep learning data-driven model for predicting structure dependent pore-fluid velocity fields in rock. The model is based on a Convolutional Auto-Encoder (CAE) artificial neural network capable of learning from image data generated by direct numerical simulations of fluid flow through pore-structures, such as by Lattice Boltzmann or molecular dynamics methods. The main novelty of the model in comparison to previous CAE-based data-driven approaches consists of three parts. The first is a methodology for decomposing the full-domain of the porous media into sub-regions, or “sub-domains”, in order to reduce the overall size of the CAE, batch process the sub-domains in parallel, and enable the CAE to learn local and generalizable nonlinear mappings of pore-fluid velocities. The second consists of embedding the finite difference solutions of the incompressible Navier-Stokes and continuity equations into convolutional layers prior to the CAE in order to provide the CAE with knowledge of fluid dynamics physics (PhyFlow). The third main novelty is that the training of the CAE is regularized with a hierarchical loss function that encourages the learning of fluid flow patterns (in a way similar to ranked modes in principal component analysis), ranking from most to least important. This is shown to increase the stability in learning, reduce over-fitting, and promote interpretability of the CAE neural network layers (HierCAE). The comprehensive new data-driven model, which we call the PhyFlow-HierCAE model, is shown to exhibit improved accuracy and generalizability of flow field predictions over conventional CAE models, attributable to the embedded physical knowledge and the hierarchical regularization, as well as realize orders of magnitude speed-ups in computation times as a surrogate for the direct numerical simulations. Examples of training and forward predictions on unseen pore-structures are provided and evaluated for data from Lattice Boltzmann and molecular dynamics simulations of pore-fluid flow. The model is shown to be a fast and accurate emulator (or “surrogate”) for predicting effective permeability of unseen pore-structures based on learning from relatively small direct numerical simulation datasets.},
doi = {10.1016/j.jcp.2021.110526},
journal = {Journal of Computational Physics},
number = ,
volume = 443,
place = {United States},
year = {Fri Oct 15 00:00:00 EDT 2021},
month = {Fri Oct 15 00:00:00 EDT 2021}
}

Works referenced in this record:

On the convergence of discrete approximations to the Navier-Stokes equations
journal, May 1969


Modelling two-phase flow in porous media at the pore scale using the volume-of-fluid method
journal, July 2012

  • Raeini, Ali Q.; Blunt, Martin J.; Bijeljic, Branko
  • Journal of Computational Physics, Vol. 231, Issue 17
  • DOI: 10.1016/j.jcp.2012.04.011

Molecular dynamics of flow in micropores
journal, August 1987

  • Bitsanis, I.; Magda, J. J.; Tirrell, M.
  • The Journal of Chemical Physics, Vol. 87, Issue 3
  • DOI: 10.1063/1.453240

Finite-Difference Approximation for Fluid-Flow Simulation and Calculation of Permeability in Porous Media
journal, June 2012

  • Shabro, Vahid; Torres-Verdín, Carlos; Javadpour, Farzam
  • Transport in Porous Media, Vol. 94, Issue 3
  • DOI: 10.1007/s11242-012-0024-y

Transport of Multicomponent Hydrocarbon Mixtures in Shale Organic Matter by Molecular Simulations
journal, September 2015

  • Collell, Julien; Galliero, Guillaume; Vermorel, Romain
  • The Journal of Physical Chemistry C, Vol. 119, Issue 39
  • DOI: 10.1021/acs.jpcc.5b07242

Computations of Absolute Permeability on Micro-CT Images
journal, December 2012

  • Mostaghimi, Peyman; Blunt, Martin J.; Bijeljic, Branko
  • Mathematical Geosciences, Vol. 45, Issue 1
  • DOI: 10.1007/s11004-012-9431-4

Deep learning
journal, May 2015

  • LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey
  • Nature, Vol. 521, Issue 7553
  • DOI: 10.1038/nature14539

Stochastic generation of explicit pore structures by thresholding Gaussian random fields
journal, November 2014


Enhancing images of shale formations by a hybrid stochastic and deep learning algorithm
journal, October 2019


The neural particle method – An updated Lagrangian physics informed neural network for computational fluid dynamics
journal, August 2020

  • Wessels, Henning; Weißenfels, Christian; Wriggers, Peter
  • Computer Methods in Applied Mechanics and Engineering, Vol. 368
  • DOI: 10.1016/j.cma.2020.113127

Direct pore-level modeling of incompressible fluid flow in porous media
journal, September 2010


Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
journal, February 2019


Deconvolution and Checkerboard Artifacts
journal, October 2016


A quasi-continuum hydrodynamic model for slit shaped nanochannel flow
journal, August 2013

  • Bhadauria, Ravi; Aluru, N. R.
  • The Journal of Chemical Physics, Vol. 139, Issue 7
  • DOI: 10.1063/1.4818165

Machine learning materials physics: Integrable deep neural networks enable scale bridging by learning free energy functions
journal, August 2019

  • Teichert, G. H.; Natarajan, A. R.; Van der Ven, A.
  • Computer Methods in Applied Mechanics and Engineering, Vol. 353
  • DOI: 10.1016/j.cma.2019.05.019

Machine learning framework for analysis of transport through complex networks in porous, granular media: A focus on permeability
journal, August 2016

  • van der Linden, Joost H.; Narsilio, Guillermo A.; Tordesillas, Antoinette
  • Physical Review E, Vol. 94, Issue 2
  • DOI: 10.1103/PhysRevE.94.022904

Hybrid pore-network and lattice-Boltzmann permeability modelling accelerated by machine learning
journal, April 2019


Fast Parallel Algorithms for Short-Range Molecular Dynamics
journal, March 1995


Nanoscale Two-Phase Flow of Methane and Water in Shale Inorganic Matrix
journal, October 2018

  • Liu, Bing; Qi, Chao; Zhao, Xiangbin
  • The Journal of Physical Chemistry C, Vol. 122, Issue 46
  • DOI: 10.1021/acs.jpcc.8b06780

Nonequilibrium molecular dynamics simulations of nanoconfined fluids at solid-liquid interfaces
journal, June 2017

  • Morciano, M.; Fasano, M.; Nold, A.
  • The Journal of Chemical Physics, Vol. 146, Issue 24
  • DOI: 10.1063/1.4986904

Numerical Calculation of Time-Dependent Viscous Incompressible Flow of Fluid with Free Surface
journal, January 1965

  • Harlow, Francis H.; Welch, J. Eddie
  • Physics of Fluids, Vol. 8, Issue 12
  • DOI: 10.1063/1.1761178

The Nose–Hoover thermostat
journal, October 1985

  • Evans, D. J.; Holian, B. L.
  • The Journal of Chemical Physics, Vol. 83, Issue 8
  • DOI: 10.1063/1.449071

Comprehensive comparison of pore-scale models for multiphase flow in porous media
journal, June 2019

  • Zhao, Benzhong; MacMinn, Christopher W.; Primkulov, Bauyrzhan K.
  • Proceedings of the National Academy of Sciences, Vol. 116, Issue 28
  • DOI: 10.1073/pnas.1901619116

A reality check on the shale revolution
journal, February 2013


Methods of estimating shale gas resources – Comparison, evaluation and implications
journal, September 2013


Impact of Nanoporosity on Hydrocarbon Transport in Shales’ Organic Matter
journal, January 2018


Lattice Boltzmann simulations of liquid CO2 displacing water in a 2D heterogeneous micromodel at reservoir pressure conditions
journal, May 2018


Neural network studies. 1. Comparison of overfitting and overtraining
journal, September 1995

  • Tetko, Igor V.; Livingstone, David J.; Luik, Alexander I.
  • Journal of Chemical Information and Modeling, Vol. 35, Issue 5
  • DOI: 10.1021/ci00027a006

Reconstruction of three-dimensional porous media using generative adversarial neural networks
journal, October 2017


Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations
journal, January 2020

  • Raissi, Maziar; Yazdani, Alireza; Karniadakis, George Em
  • Science, Vol. 367, Issue 6481
  • DOI: 10.1126/science.aaw4741

Gradient-based learning applied to document recognition
journal, January 1998

  • Lecun, Y.; Bottou, L.; Bengio, Y.
  • Proceedings of the IEEE, Vol. 86, Issue 11
  • DOI: 10.1109/5.726791

Multiphase lattice Boltzmann simulations for porous media applications: A review
journal, December 2015

  • Liu, Haihu; Kang, Qinjun; Leonardi, Christopher R.
  • Computational Geosciences, Vol. 20, Issue 4
  • DOI: 10.1007/s10596-015-9542-3

Deep learning for universal linear embeddings of nonlinear dynamics
journal, November 2018


Modeling and scale-bridging using machine learning: nanoconfinement effects in porous media
journal, August 2020


Computational engineering and science methodologies for modeling and simulation of subsurface applications
journal, August 2002


A simplified MAC technique for incompressible fluid flow calculations
journal, October 1970


Lattice Boltzmann Method for Fluid Flows
journal, January 1998


PoreFlow-Net: A 3D convolutional neural network to predict fluid flow through porous media
journal, April 2020


Reducing the Dimensionality of Data with Neural Networks
journal, July 2006


Development of a Hybrid Process and System Model for the Assessment of Wellbore Leakage at a Geologic CO 2 Sequestration Site
journal, October 2008

  • Viswanathan, Hari S.; Pawar, Rajesh J.; Stauffer, Philip H.
  • Environmental Science & Technology, Vol. 42, Issue 19
  • DOI: 10.1021/es800417x

Numerical calculation of multiphase fluid flow
journal, January 1975


Training with Noise is Equivalent to Tikhonov Regularization
journal, January 1995


CFD Python: the 12 steps to Navier-Stokes equations
journal, November 2018

  • Barba, Lorena; Forsyth, Gilbert
  • Journal of Open Source Education, Vol. 1, Issue 9
  • DOI: 10.21105/jose.00021

Data-driven computational mechanics
journal, June 2016


The Effects of Adding Noise During Backpropagation Training on a Generalization Performance
journal, April 1996