Solving differential equations with unknown constitutive relations as recurrent neural networks
We solve a system of ordinary differential equations with an unknown functional form of a sink (reaction rate) term. We assume that the measurements (time series) of state variables are partially available, and use a recurrent neural network to “learn” the reaction rate from this data. This is achieved by including discretized ordinary differential equations as part of a recurrent neural network training problem. We extend TensorFlow’s recurrent neural network architecture to create a simple but scalable and effective solver for the unknown functions, and apply it to a fedbatch bioreactor simulation problem. Use of techniques from recent deep learning literature enables training of functions with behavior manifesting over thousands of time steps. Our networks are structurally similar to recurrent neural networks, but differ in purpose, and require modified training strategies.
- Research Organization:
- Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC05-76RL01830
- OSTI ID:
- 1415706
- Report Number(s):
- PNNL-SA-130320
- Resource Relation:
- Conference: Deep Learning for the Physical Sciences (NIPS Workshop), December 8, 2017, Long Beach, California
- Country of Publication:
- United States
- Language:
- English
Similar Records
Real-Time Hybrid Modeling of Francis Hydroturbine Dynamics via a Neural Controlled Differential Equation Approach
Physics-informed Karhunen-Loeve and Neural Network Approximations for Solving Inverse Differential Equation Problems