DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: NSGA-PINN: A Multi-Objective Optimization Method for Physics-Informed Neural Network Training

Journal Article · · Algorithms
DOI: https://doi.org/10.3390/a16040194 · OSTI ID:1968107

This paper presents NSGA-PINN, a multi-objective optimization framework for the effective training of physics-informed neural networks (PINNs). The proposed framework uses the non-dominated sorting genetic algorithm (NSGA-II) to enable traditional stochastic gradient optimization algorithms (e.g., ADAM) to escape local minima effectively. Additionally, the NSGA-II algorithm enables satisfying the initial and boundary conditions encoded into the loss function during physics-informed training precisely. We demonstrate the effectiveness of our framework by applying NSGA-PINN to several ordinary and partial differential equation problems. In particular, we show that the proposed framework can handle challenging inverse problems with noisy data.

Sponsoring Organization:
USDOE
Grant/Contract Number:
382247
OSTI ID:
1968107
Journal Information:
Algorithms, Journal Name: Algorithms Vol. 16 Journal Issue: 4; ISSN 1999-4893
Publisher:
MDPI AGCopyright Statement
Country of Publication:
Switzerland
Language:
English

References (15)

Physics-informed neural networks (PINNs) for fluid mechanics: a review journal December 2021
Non-convergence of stochastic gradient descent in the training of deep neural networks journal June 2021
Physics-informed machine learning journal May 2021
Physics-informed neural networks for high-speed flows journal March 2020
Multilayer feedforward networks are universal approximators journal January 1989
Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations journal January 2020
Introduction to Evolutionary Algorithms book June 2010
A genetic approach to the quadratic assignment problem journal January 1995
Towards a Fast and Accurate EIT Inverse Problem Solver: A Machine Learning Approach journal December 2018
Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next journal July 2022
Non-convex Optimization for Machine Learning journal January 2017
A fast and elitist multiobjective genetic algorithm: NSGA-II journal April 2002
Constraint-handling in genetic algorithms through the use of dominance-based tournament selection journal July 2002
DAE-PINN: a physics-informed neural network model for simulating differential algebraic equations with application to power networks journal October 2022
Data-driven discovery of partial differential equations journal April 2017

Related Subjects