A physics-informed operator regression framework for extracting data-driven continuum models

Patel, Ravi Ghanshyam; Trask, Nathaniel Albert; Wood, Mitchell A.; Cyr, Eric C.

doi:10.1016/j.cma.2020.113500

A physics-informed operator regression framework for extracting data-driven continuum models

Journal Article · 05 November 2020 · Computer Methods in Applied Mechanics and Engineering

DOI:https://doi.org/10.1016/j.cma.2020.113500· OSTI ID:1725869

Patel, Ravi Ghanshyam ^[1]; Trask, Nathaniel Albert ^[1]; Wood, Mitchell A. ^[1]; Cyr, Eric C. ^[1]

Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

The application of deep learning toward discovery of data-driven models requires careful application of inductive biases to obtain a description of physics which is both accurate and robust. We present here a framework for discovering continuum models from high fidelity molecular simulation data. Our approach applies a neural network parameterization of governing physics in modal space, allowing a characterization of differential operators while providing structure which may be used to impose biases related to symmetry, isotropy, and conservation form. Here, we demonstrate the effectiveness of our framework for a variety of physics, including local and nonlocal diffusion processes and single and multiphase flows. For the flow physics we demonstrate this approach leads to a learned operator that generalizes to system characteristics not included in the training sets, such as variable particle sizes, densities, and concentration.

View Accepted Manuscript (DOE)

View Accepted Manuscript (Publisher)

Research Organization:: Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Sponsoring Organization:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC04-94AL85000; NA0003525

OSTI ID:: 1725869

Alternate ID(s):: OSTI ID: 1776289

Report Number(s):: SAND-2020-5359J; 686274

Journal Information:: Computer Methods in Applied Mechanics and Engineering, Vol. 373; ISSN 0045-7825

Publisher:: ElsevierCopyright Statement

Country of Publication:: United States

Language:: English

References (30)

Rotation-invariant convolutional neural networks for galaxy morphology prediction Dieleman, Sander; Willett, Kyle W.; Dambre, Joni Monthly Notices of the Royal Astronomical Society, Vol. 450, Issue 2 https://doi.org/10.1093/mnras/stv632	journal	April 2015
Deep learning LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey Nature, Vol. 521, Issue 7553 https://doi.org/10.1038/nature14539	journal	May 2015
Physics-informed machine learning approach for augmenting turbulence models: A comprehensive framework Wu, Jin-Long; Xiao, Heng; Paterson, Eric Physical Review Fluids, Vol. 3, Issue 7 https://doi.org/10.1103/PhysRevFluids.3.074602	journal	July 2018
Distilling Free-Form Natural Laws from Experimental Data Schmidt, Michael; Lipson, Hod Science, Vol. 324, Issue 5923 https://doi.org/10.1126/science.1165893	journal	April 2009
Automated reverse engineering of nonlinear dynamical systems Bongard, J.; Lipson, H. Proceedings of the National Academy of Sciences, Vol. 104, Issue 24 https://doi.org/10.1073/pnas.0609476104	journal	June 2007
From diffusion to anomalous diffusion: A century after Einstein’s Brownian motion Sokolov, I. M.; Klafter, J. Chaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 15, Issue 2 https://doi.org/10.1063/1.1860472	journal	June 2005
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations Raissi, M.; Perdikaris, P.; Karniadakis, G. E. Journal of Computational Physics, Vol. 378 https://doi.org/10.1016/j.jcp.2018.10.045	journal	February 2019
Machine learning strategies for systems with invariance properties Ling, Julia; Jones, Reese; Templeton, Jeremy Journal of Computational Physics, Vol. 318 https://doi.org/10.1016/j.jcp.2016.05.003	journal	August 2016
Discovering governing equations from data by sparse identification of nonlinear dynamical systems Brunton, Steven L.; Proctor, Joshua L.; Kutz, J. Nathan Proceedings of the National Academy of Sciences, Vol. 113, Issue 15 https://doi.org/10.1073/pnas.1517384113	journal	March 2016
Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks Zhang, Dongkun; Guo, Ling; Karniadakis, George Em SIAM Journal on Scientific Computing, Vol. 42, Issue 2 https://doi.org/10.1137/19M1260141	journal	January 2020
Compressive sensing based machine learning strategy for characterizing the flow around a cylinder with limited pressure measurements Bright, Ido; Lin, Guang; Kutz, J. Nathan Physics of Fluids, Vol. 25, Issue 12 https://doi.org/10.1063/1.4836815	journal	December 2013
PDE-Net 2.0: Learning PDEs from data with a numeric-symbolic hybrid deep network Long, Zichao; Lu, Yiping; Dong, Bin Journal of Computational Physics, Vol. 399 https://doi.org/10.1016/j.jcp.2019.108925	journal	December 2019
Data driven governing equations approximation using deep neural networks Qin, Tong; Wu, Kailiang; Xiu, Dongbin Journal of Computational Physics, Vol. 395 https://doi.org/10.1016/j.jcp.2019.06.042	journal	October 2019
Data-driven discovery of partial differential equations Rudy, Samuel H.; Brunton, Steven L.; Proctor, Joshua L. Science Advances, Vol. 3, Issue 4 https://doi.org/10.1126/sciadv.1602614	journal	April 2017
Polymorphic transitions in single crystals: A new molecular dynamics method Parrinello, M.; Rahman, A. Journal of Applied Physics, Vol. 52, Issue 12 https://doi.org/10.1063/1.328693	journal	December 1981
Inversion of 3D electromagnetic data in frequency and time domain using an inexact all‐at‐once approach Haber, Eldad; Ascher, Uri M.; Oldenburg, Douglas W. GEOPHYSICS, Vol. 69, Issue 5 https://doi.org/10.1190/1.1801938	journal	September 2004
Incorporation of memory effects in coarse-grained modeling via the Mori-Zwanzig formalism Li, Zhen; Bian, Xin; Li, Xiantao The Journal of Chemical Physics, Vol. 143, Issue 24 https://doi.org/10.1063/1.4935490	journal	December 2015
Data-driven modeling and learning in science and engineering Montáns, Francisco J.; Chinesta, Francisco; Gómez-Bombarelli, Rafael Comptes Rendus Mécanique, Vol. 347, Issue 11 https://doi.org/10.1016/j.crme.2019.11.009	journal	November 2019
Transport, Collective Motion, and Brownian Motion Mori, Hazime Progress of Theoretical Physics, Vol. 33, Issue 3 https://doi.org/10.1143/PTP.33.423	journal	March 1965
Reversible multiple time scale molecular dynamics Tuckerman, M.; Berne, B. J.; Martyna, G. J. The Journal of Chemical Physics, Vol. 97, Issue 3 https://doi.org/10.1063/1.463137	journal	August 1992
Numerical aspects for approximating governing equations using data Wu, Kailiang; Xiu, Dongbin Journal of Computational Physics, Vol. 384 https://doi.org/10.1016/j.jcp.2019.01.030	journal	May 2019
Inverse problems: A Bayesian perspective Stuart, A. M. Acta Numerica, Vol. 19 https://doi.org/10.1017/S0962492910000061	journal	May 2010
Comparison of Reduced- and Full-space Algorithms for PDE-constrained Optimization Hicken, Jason; Alonso, Juan 51st AIAA Aerospace Sciences Meeting including the New Horizons Forum and Aerospace Exposition https://doi.org/10.2514/6.2013-1043	conference	January 2013
Learning data-driven discretizations for partial differential equations Bar-Sinai, Yohai; Hoyer, Stephan; Hickey, Jason Proceedings of the National Academy of Sciences, Vol. 116, Issue 31 https://doi.org/10.1073/pnas.1814058116	journal	July 2019
Face recognition: a convolutional neural-network approach Lawrence, S.; Giles, C. L. IEEE Transactions on Neural Networks, Vol. 8, Issue 1 https://doi.org/10.1109/72.554195	journal	January 1997
A Newton-CG method for large-scale three-dimensional elastic full-waveform seismic inversion Epanomeritakis, I.; Akçelik, V.; Ghattas, O. Inverse Problems, Vol. 24, Issue 3 https://doi.org/10.1088/0266-5611/24/3/034015	journal	May 2008
Data-driven deep learning of partial differential equations in modal space Wu, Kailiang; Xiu, Dongbin Journal of Computational Physics, Vol. 408 https://doi.org/10.1016/j.jcp.2020.109307	journal	May 2020
Effective properties of composite materials with periodic microstructure: a computational approach Michel, J. C.; Moulinec, H.; Suquet, P. Computer Methods in Applied Mechanics and Engineering, Vol. 172, Issue 1-4 https://doi.org/10.1016/S0045-7825(98)00227-8	journal	April 1999
Performance and Cost Assessment of Machine Learning Interatomic Potentials Zuo, Yunxing; Chen, Chi; Li, Xiangguo The Journal of Physical Chemistry A, Vol. 124, Issue 4 https://doi.org/10.1021/acs.jpca.9b08723	journal	October 2019
Interaction potentials for soft and hard ellipsoids Everaers, R.; Ejtehadi, M. R. arXiv https://doi.org/10.48550/arxiv.cond-mat/0306096	text	January 2003

Similar Records

A differentiable, physics-informed ecosystem modeling and learning framework for large-scale inverse problems: demonstration with photosynthesis simulations

Journal Article · 2023 · Biogeosciences (Online) · OSTI ID:1997685

Aboelyazeed, Doaa; Xu, Chonggang; Hoffman, Forrest M.; +5 more

Classification of machine learning frameworks for data-driven thermal fluid models

Journal Article · 2018 · International Journal of Thermal Sciences · OSTI ID:1613917

Chang, Chih-Wei; Dinh, Nam T.

Related Subjects

42 ENGINEERING
physics-informed machine learning
operator regression
spectral methods
continuum scale modeling

A physics-informed operator regression framework for extracting data-driven continuum models

Citation Formats

References (30)

Similar Records

Related Subjects