DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: MULTISTEP AND CONTINUOUS PHYSICS-INFORMED NEURAL NETWORK METHODS FOR LEARNING GOVERNING EQUATIONS AND CONSTITUTIVE RELATIONS

Journal Article · · Journal of Machine Learning for Modeling and Computing
ORCiD logo [1];  [2];  [1];  [3]
  1. Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
  2. Univ. of Pennsylvania, Philadelphia, PA (United States)
  3. Pacific Northwest National Lab. (PNNL), Richland, WA (United States); Univ. of Illinois at Urbana-Champaign, IL (United States)

In this work, we investigate the applicability and relative merit of discrete and continuous versions of physics-informed neural network (PINN) methods for learning unknown governing equations or constitutive relations in a nonlinear dynamical system. In the case of unknown dynamics, entire right-hand-side (RHS) equations of the ordinary differential equations are unknown. In the case of unknown constitutive relations, however, the RHS equations are known up to the specification of constitutive relations (that may depend on the state of the system). We use a deep neural network to model unknown governing equations or constitutive relations. The discrete PINN approach combines classical multistep discretization methods for dynamical systems with neural-network-based machine learning methods. On the other hand, the continuous versions utilize deep neural networks to minimize the residual function for the continuous governing equations. We use the case of a fedbatch bioreactor system to study the effectiveness of these approaches and discuss conditions for their applicability. Our results indicate that the accuracy of the trained neural network models is much higher for the cases where we only have to learn a constitutive relation instead of all dynamics. This finding corroborates the well-known fact from scientific computing that building as much structural information as is available into an algorithm can enhance its efficiency and/or accuracy.

Research Organization:
Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
AC05-76RL01830; SC0019116
OSTI ID:
1924286
Report Number(s):
PNNL-SA-177559
Journal Information:
Journal of Machine Learning for Modeling and Computing, Journal Name: Journal of Machine Learning for Modeling and Computing Journal Issue: 2 Vol. 3; ISSN 2689-3967
Publisher:
Begell HouseCopyright Statement
Country of Publication:
United States
Language:
English

References (17)

A hybrid neural network-first principles approach to process modeling journal October 1992
Physics-informed neural networks for multiphysics data assimilation with application to subsurface transport journal July 2020
Artificial intelligence as a sustainable tool in wastewater treatment using membrane bioreactors journal August 2021
DGM: A deep learning algorithm for solving partial differential equations journal December 2018
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations journal February 2019
A First Course in the Numerical Analysis of Differential Equations book January 2008
Physics‐Informed Deep Neural Networks for Learning Parameters and Constitutive Relationships in Subsurface Flow Problems journal May 2020
Physics‐Informed Neural Network Method for Forward and Backward Advection‐Dispersion Equations journal July 2021
Physics-informed machine learning journal May 2021
Solving high-dimensional partial differential equations using deep learning journal August 2018
Randomly distributed embedding making short-term high-dimensional data predictable journal October 2018
Adaptive Control of Fedbatch Bioreactors journal January 1990
Nonparametric forecasting of low-dimensional dynamical systems journal March 2015
Learning unknown physics of non-Newtonian fluids journal July 2021
Data-assisted reduced-order modeling of extreme events in complex dynamical systems journal May 2018
Physics-Constrained, Data-Driven Discovery of Coarse-Grained Dynamics journal January 2019
On the Convergence of Physics Informed Neural Networks for Linear Second-Order Elliptic and Parabolic Type PDEs journal June 2020