Physics-informed machine learning

Karniadakis, George Em; Kevrekidis, Ioannis G.; Lu, Lu; Perdikaris, Paris; Wang, Sifan; Yang, Liu

doi:10.1038/s42254-021-00314-5

Physics-informed machine learning

Journal Article · Mon May 24 00:00:00 EDT 2021 · Nature Reviews Physics

DOI:https://doi.org/10.1038/s42254-021-00314-5· OSTI ID:1852843

^[1]; Kevrekidis, Ioannis G.; ; Perdikaris, Paris; Wang, Sifan;

OSTI

Not provided.

Research Organization:: Univ. of Pennsylvania, Philadelphia, PA (United States); Brown Univ., Providence, RI (United States)

Sponsoring Organization:: USDOE Office of Science (SC)

DOE Contract Number:: SC0019116; SC0019453

OSTI ID:: 1852843

Journal Information:: Nature Reviews Physics, Journal Name: Nature Reviews Physics Journal Issue: 6 Vol. 3; ISSN 2522-5820

Publisher:: Springer Nature

Country of Publication:: United States

Language:: English

References (124)

Extended Physics-Informed Neural Networks (XPINNs): A Generalized Space-Time Domain Decomposition Based Deep Learning Framework for Nonlinear Partial Differential Equations Karniadakis, Ameya D. Jagtap & George Em Communications in Computational Physics, Vol. 28, Issue 5 https://doi.org/10.4208/cicp.OA-2020-0164	journal	June 2020
Integrating machine learning and multiscale modeling—perspectives, challenges, and opportunities in the biological, biomedical, and behavioral sciences Alber, Mark; Buganza Tepole, Adrian; Cannon, William R. npj Digital Medicine, Vol. 2, Issue 1 https://doi.org/10.1038/s41746-019-0193-y	journal	November 2019
DeepXDE: A Deep Learning Library for Solving Differential Equations Lu, Lu; Meng, Xuhui; Mao, Zhiping SIAM Review, Vol. 63, Issue 1 https://doi.org/10.1137/19M1274067	journal	January 2021
Coupled Time‐Lapse Full‐Waveform Inversion for Subsurface Flow Problems Using Intrusive Automatic Differentiation Li, Dongzhuo; Xu, Kailai; Harris, Jerry M. Water Resources Research, Vol. 56, Issue 8 https://doi.org/10.1029/2019WR027032	journal	August 2020
Physically informed artificial neural networks for atomistic modeling of materials Pun, G. P. Purja; Batra, R.; Ramprasad, R. Nature Communications, Vol. 10, Issue 1 https://doi.org/10.1038/s41467-019-10343-5	journal	May 2019
Backpropagation algorithms and Reservoir Computing in Recurrent Neural Networks for the forecasting of complex spatiotemporal dynamics Vlachas, P. R.; Pathak, J.; Hunt, B. R. Neural Networks, Vol. 126 https://doi.org/10.1016/j.neunet.2020.02.016	journal	June 2020
Machine learning of linear differential equations using Gaussian processes Raissi, Maziar; Perdikaris, Paris; Karniadakis, George Em Journal of Computational Physics, Vol. 348 https://doi.org/10.1016/j.jcp.2017.07.050	journal	November 2017
Gaussian measure in Hilbert space and applications in numerical analysis Larkin, F. M. Rocky Mountain Journal of Mathematics, Vol. 2, Issue 3 https://doi.org/10.1216/RMJ-1972-2-3-379	journal	September 1972
Simulator-free solution of high-dimensional stochastic elliptic partial differential equations using deep neural networks Karumuri, Sharmila; Tripathy, Rohit; Bilionis, Ilias Journal of Computational Physics, Vol. 404 https://doi.org/10.1016/j.jcp.2019.109120	journal	March 2020
Stochastic spectral methods for efficient Bayesian solution of inverse problems Marzouk, Youssef M.; Najm, Habib N.; Rahn, Larry A. Journal of Computational Physics, Vol. 224, Issue 2 https://doi.org/10.1016/j.jcp.2006.10.010	journal	June 2007
SciANN: A Keras/TensorFlow wrapper for scientific computations and physics-informed deep learning using artificial neural networks Haghighat, Ehsan; Juanes, Ruben Computer Methods in Applied Mechanics and Engineering, Vol. 373 https://doi.org/10.1016/j.cma.2020.113552	journal	January 2021
Solving initial-boundary value problems for systems of partial differential equations using neural networks and optimization techniques Shekari Beidokhti, R.; Malek, A. Journal of the Franklin Institute, Vol. 346, Issue 9 https://doi.org/10.1016/j.jfranklin.2009.05.003	journal	November 2009
Prediction of vegetation dynamics using NDVI time series data and LSTM Reddy, D. Sushma; Prasad, P. Rama Chandra Modeling Earth Systems and Environment, Vol. 4, Issue 1 https://doi.org/10.1007/s40808-018-0431-3	journal	February 2018
Learning unknown physics of non-Newtonian fluids Reyes, Brandon; Howard, Amanda A.; Perdikaris, Paris Physical Review Fluids, Vol. 6, Issue 7 https://doi.org/10.1103/PhysRevFluids.6.073301	journal	July 2021
Training a 3-node neural network is NP-complete Blum, Avrim L.; Rivest, Ronald L. Neural Networks, Vol. 5, Issue 1 https://doi.org/10.1016/S0893-6080(05)80010-3	journal	January 1992
Multi-Scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains Liu, Ziqi Communications in Computational Physics, Vol. 28, Issue 5 https://doi.org/10.4208/cicp.OA-2020-0179	journal	June 2020
Multi-Scale Deep Neural Network (MscaleDNN) Methods for Oscillatory Stokes Flows in Complex Domains Wang, Bo Communications in Computational Physics, Vol. 28, Issue 5 https://doi.org/10.4208/cicp.OA-2020-0192	journal	June 2020
Multigrid with Rough Coefficients and Multiresolution Operator Decomposition from Hierarchical Information Games Owhadi, Houman SIAM Review, Vol. 59, Issue 1 https://doi.org/10.1137/15M1013894	journal	January 2017
Invariant Scattering Convolution Networks Bruna, Joan; Mallat, S. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, Issue 8 https://doi.org/10.1109/TPAMI.2012.230	journal	August 2013
Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks Xu, Zhi-Qin John Communications in Computational Physics, Vol. 28, Issue 5 https://doi.org/10.4208/cicp.OA-2020-0085	journal	June 2020
Jamming transition as a paradigm to understand the loss landscape of deep neural networks Geiger, Mario; Spigler, Stefano; d'Ascoli, Stéphane Physical Review E, Vol. 100, Issue 1 https://doi.org/10.1103/PhysRevE.100.012115	journal	July 2019
Environmental Sensor Networks: A revolution in the earth system science? Hart, Jane K.; Martinez, Kirk Earth-Science Reviews, Vol. 78, Issue 3-4 https://doi.org/10.1016/j.earscirev.2006.05.001	journal	October 2006
Physics‐Informed Deep Neural Networks for Learning Parameters and Constitutive Relationships in Subsurface Flow Problems Tartakovsky, A. M.; Marrero, C. Ortiz; Perdikaris, Paris Water Resources Research, Vol. 56, Issue 5 https://doi.org/10.1029/2019WR026731	journal	May 2020
Reconciling modern machine-learning practice and the classical bias–variance trade-off Belkin, Mikhail; Hsu, Daniel; Ma, Siyuan Proceedings of the National Academy of Sciences, Vol. 116, Issue 32 https://doi.org/10.1073/pnas.1903070116	journal	July 2019
Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks Zhu, Jun-Yan; Park, Taesung; Isola, Phillip 2017 IEEE International Conference on Computer Vision (ICCV) https://doi.org/10.1109/ICCV.2017.244	conference	October 2017
Flow over an espresso cup: inferring 3-D velocity and pressure fields from tomographic background oriented Schlieren via physics-informed neural networks Cai, Shengze; Wang, Zhicheng; Fuest, Frederik Journal of Fluid Mechanics, Vol. 915 https://doi.org/10.1017/jfm.2021.135	journal	March 2021
Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems Zhang, Dongkun; Lu, Lu; Guo, Ling Journal of Computational Physics, Vol. 397 https://doi.org/10.1016/j.jcp.2019.07.048	journal	November 2019
PFNN: A penalty-free neural network method for solving a class of second-order boundary-value problems on complex geometries Sheng, Hailong; Yang, Chao Journal of Computational Physics, Vol. 428 https://doi.org/10.1016/j.jcp.2020.110085	journal	March 2021
A method for representing periodic functions and enforcing exactly periodic boundary conditions with deep neural networks Dong, Suchuan; Ni, Naxian Journal of Computational Physics, Vol. 435 https://doi.org/10.1016/j.jcp.2021.110242	journal	June 2021
Deep learning of free boundary and Stefan problems Wang, Sifan; Perdikaris, Paris Journal of Computational Physics, Vol. 428 https://doi.org/10.1016/j.jcp.2020.109914	journal	March 2021
Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks Kissas, Georgios; Yang, Yibo; Hwuang, Eileen Computer Methods in Applied Mechanics and Engineering, Vol. 358 https://doi.org/10.1016/j.cma.2019.112623	journal	January 2020
A Phase Shift Deep Neural Network for High Frequency Approximation and Wave Problems Cai, Wei; Li, Xiaoguang; Liu, Lizuo SIAM Journal on Scientific Computing, Vol. 42, Issue 5 https://doi.org/10.1137/19M1310050	journal	January 2020
Coarse-graining auto-encoders for molecular dynamics Wang, Wujie; Gómez-Bombarelli, Rafael npj Computational Materials, Vol. 5, Issue 1 https://doi.org/10.1038/s41524-019-0261-5	journal	December 2019
Benchmark Analysis of Representative Deep Neural Network Architectures Bianco, Simone; Cadene, Remi; Celona, Luigi IEEE Access, Vol. 6 https://doi.org/10.1109/ACCESS.2018.2877890	journal	January 2018
Error estimates for DeepONets: a deep learning framework in infinite dimensions Lanthaler, Samuel; Mishra, Siddhartha; Karniadakis, George E. Transactions of Mathematics and Its Applications, Vol. 6, Issue 1 https://doi.org/10.1093/imatrm/tnac001	journal	March 2022
hp-VPINNs: Variational physics-informed neural networks with domain decomposition Kharazmi, Ehsan; Zhang, Zhongqiang; Karniadakis, George E. M. Computer Methods in Applied Mechanics and Engineering, Vol. 374 https://doi.org/10.1016/j.cma.2020.113547	journal	February 2021
Extraction of mechanical properties of materials through deep learning from instrumented indentation Lu, Lu; Dao, Ming; Kumar, Punit Proceedings of the National Academy of Sciences, Vol. 117, Issue 13 https://doi.org/10.1073/pnas.1922210117	journal	March 2020
A jamming transition from under- to over-parametrization affects generalization in deep learning Spigler, S.; Geiger, M.; d’Ascoli, S. Journal of Physics A: Mathematical and Theoretical, Vol. 52, Issue 47 https://doi.org/10.1088/1751-8121/ab4c8b	journal	October 2019
A Proposal on Machine Learning via Dynamical Systems E., Weinan Communications in Mathematics and Statistics, Vol. 5, Issue 1 https://doi.org/10.1007/s40304-017-0103-z	journal	March 2017
Modeling the dynamics of PDE systems with physics-constrained deep auto-regressive networks Geneva, Nicholas; Zabaras, Nicholas Journal of Computational Physics, Vol. 403 https://doi.org/10.1016/j.jcp.2019.109056	journal	February 2020
Conditional deep surrogate models for stochastic, high-dimensional, and multi-fidelity systems Yang, Yibo; Perdikaris, Paris Computational Mechanics, Vol. 64, Issue 2 https://doi.org/10.1007/s00466-019-01718-y	journal	May 2019
Learning dynamical systems from data: A simple cross-validation perspective, part I: Parametric kernel flows Hamzi, Boumediene; Owhadi, Houman Physica D: Nonlinear Phenomena, Vol. 421 https://doi.org/10.1016/j.physd.2020.132817	journal	July 2021
A Correspondence Between Bayesian Estimation on Stochastic Processes and Smoothing by Splines Kimeldorf, George S.; Wahba, Grace The Annals of Mathematical Statistics, Vol. 41, Issue 2 https://doi.org/10.1214/aoms/1177697089	journal	April 1970
“Forget time”: Essay written for the FQXi contest on the Nature of Time Rovelli, Carlo Foundations of Physics, Vol. 41, Issue 9 https://doi.org/10.1007/s10701-011-9561-4	journal	May 2011
Deep learning for universal linear embeddings of nonlinear dynamics Lusch, Bethany; Kutz, J. Nathan; Brunton, Steven L. Nature Communications, Vol. 9, Issue 1 https://doi.org/10.1038/s41467-018-07210-0	journal	November 2018
Linking Machine Learning with Multiscale Numerics: Data-Driven Discovery of Homogenized Equations Arbabi, Hassan; Bunder, Judith E.; Samaey, Giovanni JOM, Vol. 72, Issue 12 https://doi.org/10.1007/s11837-020-04399-8	journal	October 2020
Ab initio solution of the many-electron Schrödinger equation with deep neural networks Pfau, David; Spencer, James S.; Matthews, Alexander G. D. G. Physical Review Research, Vol. 2, Issue 3 https://doi.org/10.1103/PhysRevResearch.2.033429	journal	September 2020
Artificial neural networks for solving ordinary and partial differential equations Lagaris, I. E.; Likas, A.; Fotiadis, D. I. IEEE Transactions on Neural Networks, Vol. 9, Issue 5 https://doi.org/10.1109/72.712178	journal	January 1998
An Emergent Space for Distributed Data With Hidden Internal Order Through Manifold Learning Kemeth, Felix P.; Haugland, Sindre W.; Dietrich, Felix IEEE Access, Vol. 6 https://doi.org/10.1109/ACCESS.2018.2882777	journal	January 2018
The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations Xiu, Dongbin; Karniadakis, George Em SIAM Journal on Scientific Computing, Vol. 24, Issue 2 https://doi.org/10.1137/S1064827501387826	journal	January 2002
Transfer learning enhanced physics informed neural network for phase-field modeling of fracture Goswami, Somdatta; Anitescu, Cosmin; Chakraborty, Souvik Theoretical and Applied Fracture Mechanics, Vol. 106 https://doi.org/10.1016/j.tafmec.2019.102447	journal	April 2020
Artificial Neural Network Method for Solution of Boundary Value Problems With Exact Satisfaction of Arbitrary Boundary Conditions McFall, K. S.; Mahan, J. R. IEEE Transactions on Neural Networks, Vol. 20, Issue 8 https://doi.org/10.1109/TNN.2009.2020735	journal	August 2009
On some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton–Jacobi partial differential equations Darbon, Jérôme; Meng, Tingwei Journal of Computational Physics, Vol. 425 https://doi.org/10.1016/j.jcp.2020.109907	journal	January 2021
Deep Residual Learning for Image Recognition He, Kaiming; Zhang, Xiangyu; Ren, Shaoqing 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2016.90	conference	June 2016
Deep learning and process understanding for data-driven Earth system science Reichstein, Markus; Camps-Valls, Gustau; Stevens, Bjorn Nature, Vol. 566, Issue 7743 https://doi.org/10.1038/s41586-019-0912-1	journal	February 2019
B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data Yang, Liu; Meng, Xuhui; Karniadakis, George Em Journal of Computational Physics, Vol. 425 https://doi.org/10.1016/j.jcp.2020.109913	journal	January 2021
Relu Deep Neural Networks and Linear Finite Elements sci, Juncai He Journal of Computational Mathematics, Vol. 38, Issue 3 https://doi.org/10.4208/jcm.1901-m2018-0160	journal	February 2020
Reynolds averaged turbulence modelling using deep neural networks with embedded invariance Ling, Julia; Kurzawski, Andrew; Templeton, Jeremy Journal of Fluid Mechanics, Vol. 807 https://doi.org/10.1017/jfm.2016.615	journal	October 2016
NeuroDiffEq: A Python package for solving differential equations with neural networks Chen, Feiyu; Sondak, David; Protopapas, Pavlos Journal of Open Source Software, Vol. 5, Issue 46 https://doi.org/10.21105/joss.01931	journal	February 2020
Why and when can deep-but not shallow-networks avoid the curse of dimensionality: A review Poggio, Tomaso; Mhaskar, Hrushikesh; Rosasco, Lorenzo International Journal of Automation and Computing, Vol. 14, Issue 5 https://doi.org/10.1007/s11633-017-1054-2	journal	March 2017
Identification of distributed parameter systems: A neural net based approach González-García, R.; Rico-Martínez, R.; Kevrekidis, I. G. Computers & Chemical Engineering, Vol. 22 https://doi.org/10.1016/S0098-1354(98)00191-4	journal	March 1998
DGM: A deep learning algorithm for solving partial differential equations Sirignano, Justin; Spiliopoulos, Konstantinos Journal of Computational Physics, Vol. 375 https://doi.org/10.1016/j.jcp.2018.08.029	journal	December 2018
fPINNs: Fractional Physics-Informed Neural Networks Pang, Guofei; Lu, Lu; Karniadakis, George Em SIAM Journal on Scientific Computing, Vol. 41, Issue 4 https://doi.org/10.1137/18M1229845	journal	January 2019
Operator-Adapted Wavelets, Fast Solvers, and Numerical Homogenization Owhadi, Houman; Scovel, Clint Cambridge Monographs on Applied and Computational Mathematics, Vol. 35 https://doi.org/10.1017/9781108594967	journal	January 2019
Geometric Deep Learning: Going beyond Euclidean data Bronstein, Michael M.; Bruna, Joan; LeCun, Yann IEEE Signal Processing Magazine, Vol. 34, Issue 4 https://doi.org/10.1109/MSP.2017.2693418	journal	July 2017
Fast Parallel Algorithms for Short-Range Molecular Dynamics Plimpton, Steve Journal of Computational Physics, Vol. 117, Issue 1 https://doi.org/10.1006/jcph.1995.1039	journal	March 1995
Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification Tripathy, Rohit K.; Bilionis, Ilias Journal of Computational Physics, Vol. 375 https://doi.org/10.1016/j.jcp.2018.08.036	journal	December 2018
DISCRETE- vs. CONTINUOUS-TIME NONLINEAR SIGNAL PROCESSING OF Cu ELECTRODISSOLUTION DATA Rico-MartÍNez, R.; Krischer, K.; Kevrekidis, I. G. Chemical Engineering Communications, Vol. 118, Issue 1 https://doi.org/10.1080/00986449208936084	journal	November 1992
A point-cloud deep learning framework for prediction of fluid flow fields on irregular geometries Kashefi, Ali; Rempe, Davis; Guibas, Leonidas J. Physics of Fluids, Vol. 33, Issue 2 https://doi.org/10.1063/5.0033376	journal	February 2021
Adversarial uncertainty quantification in physics-informed neural networks Yang, Yibo; Perdikaris, Paris Journal of Computational Physics, Vol. 394 https://doi.org/10.1016/j.jcp.2019.05.027	journal	October 2019
DPM: A deep learning PDE augmentation method with application to large-eddy simulation Sirignano, Justin; MacArt, Jonathan F.; Freund, Jonathan B. Journal of Computational Physics, Vol. 423 https://doi.org/10.1016/j.jcp.2020.109811	journal	December 2020
Uncovering turbulent plasma dynamics via deep learning from partial observations Mathews, A.; Francisquez, M.; Hughes, J. W. Physical Review E, Vol. 104, Issue 2 https://doi.org/10.1103/PhysRevE.104.025205	journal	August 2021
DeepM&Mnet for hypersonics: Predicting the coupled flow and finite-rate chemistry behind a normal shock using neural-network approximation of operators Mao, Zhiping; Lu, Lu; Marxen, Olaf Journal of Computational Physics, Vol. 447 https://doi.org/10.1016/j.jcp.2021.110698	journal	December 2021
Deep Potential Molecular Dynamics: A Scalable Model with the Accuracy of Quantum Mechanics Zhang, Linfeng; Han, Jiequn; Wang, Han Physical Review Letters, Vol. 120, Issue 14 https://doi.org/10.1103/PhysRevLett.120.143001	journal	April 2018
Large scale and linear scaling DFT with the CONQUEST code Nakata, Ayako; Baker, Jack S.; Mujahed, Shereif Y. The Journal of Chemical Physics, Vol. 152, Issue 16 https://doi.org/10.1063/5.0005074	journal	April 2020
Scaling description of generalization with number of parameters in deep learning Geiger, Mario; Jacot, Arthur; Spigler, Stefano Journal of Statistical Mechanics: Theory and Experiment, Vol. 2020, Issue 2 https://doi.org/10.1088/1742-5468/ab633c	journal	February 2020
Universal Differential Equations for Scientific Machine Learning Rackauckas, Christopher; Ma, Yingbo; Martensen, Julius https://doi.org/10.21203/rs.3.rs-55125/v1	preprint	August 2020
Conservative physics-informed neural networks on discrete domains for conservation laws: Applications to forward and inverse problems Jagtap, Ameya D.; Kharazmi, Ehsan; Karniadakis, George Em Computer Methods in Applied Mechanics and Engineering, Vol. 365 https://doi.org/10.1016/j.cma.2020.113028	journal	June 2020
Discovering governing equations from data by sparse identification of nonlinear dynamical systems Brunton, Steven L.; Proctor, Joshua L.; Kutz, J. Nathan Proceedings of the National Academy of Sciences, Vol. 113, Issue 15 https://doi.org/10.1073/pnas.1517384113	journal	March 2016
AutoML: A survey of the state-of-the-art He, Xin; Zhao, Kaiyong; Chu, Xiaowen Knowledge-Based Systems, Vol. 212 https://doi.org/10.1016/j.knosys.2020.106622	journal	January 2021
A robotic Intelligent Towing Tank for learning complex fluid-structure dynamics Fan, D.; Jodin, G.; Consi, T. R. Science Robotics, Vol. 4, Issue 36 https://doi.org/10.1126/scirobotics.aay5063	journal	November 2019
Inverse problems: A Bayesian perspective Stuart, A. M. Acta Numerica, Vol. 19 https://doi.org/10.1017/S0962492910000061	journal	May 2010
Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators Lu, Lu; Jin, Pengzhan; Pang, Guofei Nature Machine Intelligence, Vol. 3, Issue 3 https://doi.org/10.1038/s42256-021-00302-5	journal	March 2021
Uncovering electron scattering mechanisms in NiFeCoCrMn derived concentrated solid solution and high entropy alloys Mu, Sai; Samolyuk, German D.; Wimmer, Sebastian npj Computational Materials, Vol. 5, Issue 1 https://doi.org/10.1038/s41524-018-0138-z	journal	January 2019
Enforcing statistical constraints in generative adversarial networks for modeling chaotic dynamical systems Wu, Jin-Long; Kashinath, Karthik; Albert, Adrian Journal of Computational Physics, Vol. 406 https://doi.org/10.1016/j.jcp.2019.109209	journal	April 2020
A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems Meng, Xuhui; Karniadakis, George Em Journal of Computational Physics, Vol. 401 https://doi.org/10.1016/j.jcp.2019.109020	journal	January 2020
Predicting molecular properties with covariant compositional networks Hy, Truong Son; Trivedi, Shubhendu; Pan, Horace The Journal of Chemical Physics, Vol. 148, Issue 24 https://doi.org/10.1063/1.5024797	journal	June 2018
Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations Raissi, Maziar; Yazdani, Alireza; Karniadakis, George Em Science, Vol. 367, Issue 6481 https://doi.org/10.1126/science.aaw4741	journal	January 2020
Bayesian differential programming for robust systems identification under uncertainty Yang, Yibo; Aziz Bhouri, Mohamed; Perdikaris, Paris Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 476, Issue 2243 https://doi.org/10.1098/rspa.2020.0290	journal	November 2020
A Limited Memory Algorithm for Bound Constrained Optimization Byrd, Richard H.; Lu, Peihuang; Nocedal, Jorge SIAM Journal on Scientific Computing, Vol. 16, Issue 5 https://doi.org/10.1137/0916069	journal	September 1995
Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations Yang, Liu; Zhang, Dongkun; Karniadakis, George Em SIAM Journal on Scientific Computing, Vol. 42, Issue 1 https://doi.org/10.1137/18M1225409	journal	January 2020
Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data Zhu, Yinhao; Zabaras, Nicholas; Koutsourelakis, Phaedon-Stelios Journal of Computational Physics, Vol. 394 https://doi.org/10.1016/j.jcp.2019.05.024	journal	October 2019
Locally adaptive activation functions with slope recovery for deep and physics-informed neural networks Jagtap, Ameya D.; Kawaguchi, Kenji; Em Karniadakis, George Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 476, Issue 2239 https://doi.org/10.1098/rspa.2020.0334	journal	July 2020
Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks Zhang, Dongkun; Guo, Ling; Karniadakis, George Em SIAM Journal on Scientific Computing, Vol. 42, Issue 2 https://doi.org/10.1137/19M1260141	journal	January 2020
Pushing the Limit of Molecular Dynamics with Ab Initio Accuracy to 100 Million Atoms with Machine Learning Jia, Weile; Wang, Han; Chen, Mohan SC20: International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC41405.2020.00009	conference	November 2020
On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks Wang, Sifan; Wang, Hanwen; Perdikaris, Paris Computer Methods in Applied Mechanics and Engineering, Vol. 384 https://doi.org/10.1016/j.cma.2021.113938	journal	October 2021
On the Convergence of Physics Informed Neural Networks for Linear Second-Order Elliptic and Parabolic Type PDEs Shin, Yeonjong Communications in Computational Physics, Vol. 28, Issue 5 https://doi.org/10.4208/cicp.OA-2020-0193	journal	June 2020
Inferring solutions of differential equations using noisy multi-fidelity data Raissi, Maziar; Perdikaris, Paris; Karniadakis, George Em Journal of Computational Physics, Vol. 335 https://doi.org/10.1016/j.jcp.2017.01.060	journal	April 2017
ConvPDE-UQ: Convolutional neural networks with quantified uncertainty for heterogeneous elliptic partial differential equations on varied domains Winovich, Nick; Ramani, Karthik; Lin, Guang Journal of Computational Physics, Vol. 394 https://doi.org/10.1016/j.jcp.2019.05.026	journal	October 2019
DifferentialEquations.jl – A Performant and Feature-Rich Ecosystem for Solving Differential Equations in Julia Rackauckas, Christopher; Nie, Qing Journal of Open Research Software, Vol. 5 https://doi.org/10.5334/jors.151	journal	May 2017
Transformer Dissection: An Unified Understanding for Transformer’s Attention via the Lens of Kernel Tsai, Yao-Hung Hubert; Bai, Shaojie; Yamada, Makoto Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) https://doi.org/10.18653/v1/D19-1443	conference	January 2019
SympNets: Intrinsic structure-preserving symplectic networks for identifying Hamiltonian systems Jin, Pengzhan; Zhang, Zhen; Zhu, Aiqing Neural Networks, Vol. 132 https://doi.org/10.1016/j.neunet.2020.08.017	journal	December 2020
Kernel Flows: From learning kernels from data into the abyss Owhadi, Houman; Yoo, Gene Ryan Journal of Computational Physics, Vol. 389 https://doi.org/10.1016/j.jcp.2019.03.040	journal	July 2019
DeepM&Mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks Cai, Shengze; Wang, Zhicheng; Lu, Lu Journal of Computational Physics, Vol. 436 https://doi.org/10.1016/j.jcp.2021.110296	journal	July 2021
SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient Yu, Lantao; Zhang, Weinan; Wang, Jun Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 31, Issue 1 https://doi.org/10.1609/aaai.v31i1.10804	journal	February 2017
Solving high-dimensional partial differential equations using deep learning Han, Jiequn; Jentzen, Arnulf; E., Weinan Proceedings of the National Academy of Sciences, Vol. 115, Issue 34 https://doi.org/10.1073/pnas.1718942115	journal	August 2018
Systematic Construction of Neural Forms for Solving Partial Differential Equations Inside Rectangular Domains, Subject to Initial, Boundary and Interface Conditions Lagari, Pola Lydia; Tsoukalas, Lefteri H.; Safarkhani, Salar International Journal on Artificial Intelligence Tools, Vol. 29, Issue 05 https://doi.org/10.1142/S0218213020500098	journal	August 2020
Discovering Physical Concepts with Neural Networks Iten, Raban; Metger, Tony; Wilming, Henrik Physical Review Letters, Vol. 124, Issue 1 https://doi.org/10.1103/PhysRevLett.124.010508	journal	January 2020
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations Raissi, M.; Perdikaris, P.; Karniadakis, G. E. Journal of Computational Physics, Vol. 378 https://doi.org/10.1016/j.jcp.2018.10.045	journal	February 2019
Understanding deep convolutional networks Mallat, Stéphane Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 374, Issue 2065 https://doi.org/10.1098/rsta.2015.0203	journal	April 2016
A mean field view of the landscape of two-layer neural networks Mei, Song; Montanari, Andrea; Nguyen, Phan-Minh Proceedings of the National Academy of Sciences, Vol. 115, Issue 33 https://doi.org/10.1073/pnas.1806579115	journal	July 2018
Double-slit photoelectron interference in strong-field ionization of the neon dimer Kunitski, Maksim; Eicke, Nicolas; Huber, Pia Nature Communications, Vol. 10, Issue 1 https://doi.org/10.1038/s41467-018-07882-8	journal	January 2019
The Harvard Clean Energy Project: Large-Scale Computational Screening and Design of Organic Photovoltaics on the World Community Grid Hachmann, Johannes; Olivares-Amaya, Roberto; Atahan-Evrenk, Sule The Journal of Physical Chemistry Letters, Vol. 2, Issue 17 https://doi.org/10.1021/jz200866s	journal	August 2011
Metric-based upscaling Owhadi, Houman; Zhang, Lei Communications on Pure and Applied Mathematics, Vol. 60, Issue 5 https://doi.org/10.1002/cpa.20163	journal	January 2007
Learning constitutive relations using symmetric positive definite neural networks Xu, Kailai; Huang, Daniel Z.; Darve, Eric Journal of Computational Physics, Vol. 428 https://doi.org/10.1016/j.jcp.2020.110072	journal	March 2021
Distilling Free-Form Natural Laws from Experimental Data Schmidt, Michael; Lipson, Hod Science, Vol. 324, Issue 5923 https://doi.org/10.1126/science.1165893	journal	April 2009
Bayesian Numerical Homogenization Owhadi, Houman Multiscale Modeling & Simulation, Vol. 13, Issue 3 https://doi.org/10.1137/140974596	journal	January 2015
Exascale Deep Learning for Climate Analytics Kurth, Thorsten; Treichler, Sean; Romero, Joshua SC18: International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2018.00054	conference	November 2018
Numerical Gaussian Processes for Time-Dependent and Nonlinear Partial Differential Equations Raissi, Maziar; Perdikaris, Paris; Karniadakis, George Em SIAM Journal on Scientific Computing, Vol. 40, Issue 1 https://doi.org/10.1137/17M1120762	journal	January 2018
Physics-Informed Neural Network for Ultrasound Nondestructive Quantification of Surface Breaking Cracks Shukla, Khemraj; Di Leoni, Patricio Clark; Blackshire, James Journal of Nondestructive Evaluation, Vol. 39, Issue 3 https://doi.org/10.1007/s10921-020-00705-1	journal	August 2020
Deep neural network approach to forward-inverse problems Jo, Hyeontae; Son, Hwijae; Ju Hwang, Hyung Networks & Heterogeneous Media, Vol. 15, Issue 2 https://doi.org/10.3934/nhm.2020011	journal	January 2020
Generalized Neural-Network Representation of High-Dimensional Potential-Energy Surfaces Behler, Jörg; Parrinello, Michele Physical Review Letters, Vol. 98, Issue 14 https://doi.org/10.1103/PhysRevLett.98.146401	journal	April 2007
Neural-net-induced Gaussian process regression for function approximation and PDE solution Pang, Guofei; Yang, Liu; Karniadakis, George Em Journal of Computational Physics, Vol. 384 https://doi.org/10.1016/j.jcp.2019.01.045	journal	May 2019
MgNet: A unified framework of multigrid and convolutional neural network He, Juncai; Xu, Jinchao Science China Mathematics, Vol. 62, Issue 7 https://doi.org/10.1007/s11425-019-9547-2	journal	May 2019

Cited By (4)

Physics-Informed Neural Operator for Fast and Scalable Optical Fiber Channel Modelling in Multi-Span Transmission Song, Yuchen; Wang, Danshi; Fan, Qirui arXiv https://doi.org/10.48550/arxiv.2208.08868	preprint	January 2022
Extreme vorticity events in turbulent Rayleigh-Bénard convection from stereoscopic measurements and reservoir computing Valori, Valentina; Kräuter, Robert; Schumacher, Jörg Physical Review Research, Vol. 4, Issue 2 https://doi.org/10.1103/physrevresearch.4.023180	journal	June 2022
Solving and Learning Nonlinear PDEs with Gaussian Processes Chen, Yifan; Hosseini, Bamdad; Owhadi, Houman arXiv https://doi.org/10.48550/arxiv.2103.12959	preprint	January 2021
Emerging Directions in Geophysical Inversion Valentine, Andrew; Sambridge, Malcolm arXiv https://doi.org/10.48550/arxiv.2110.06017	text	January 2021

Similar Records

Physics-informed machine learning

Journal Article · Mon May 24 00:00:00 EDT 2021 · Nature Reviews Physics · OSTI ID:2282016

Role of physics in physics-informed machine learning

Journal Article · Sun Dec 31 23:00:00 EST 2023 · Journal of Machine Learning for Modeling and Computing · OSTI ID:2350949

A Review of Physics-Informed Machine Learning in Fluid Mechanics

Journal Article · Mon Feb 27 23:00:00 EST 2023 · Energies · OSTI ID:1959241

Related Subjects

Physics

Physics-informed machine learning

Citation Formats

References (124)

Cited By (4)

Similar Records

Related Subjects