DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Fourier neural networks as function approximators and differential equation solvers

Journal Article · · Statistical Analysis and Data Mining
DOI: https://doi.org/10.1002/sam.11531 · OSTI ID:1829916

Abstract We present a Fourier neural network (FNN) that can be mapped directly to the Fourier decomposition. The choice of activation and loss function yields results that replicate a Fourier series expansion closely while preserving a straightforward architecture with a single hidden layer. The simplicity of this network architecture facilitates the integration with any other higher‐complexity networks, at a data pre‐ or postprocessing stage. We validate this FNN on naturally periodic smooth functions and on piecewise continuous periodic functions. We showcase the use of this FNN for modeling or solving partial differential equations with periodic boundary conditions. The main advantages of the current approach are the validity of the solution outside the training region, interpretability of the trained model, and simplicity of use.

Sponsoring Organization:
USDOE
OSTI ID:
1829916
Journal Information:
Statistical Analysis and Data Mining, Journal Name: Statistical Analysis and Data Mining Journal Issue: 6 Vol. 14; ISSN 1932-1864
Publisher:
Wiley Blackwell (John Wiley & Sons)Copyright Statement
Country of Publication:
United States
Language:
English

References (13)

Object Recognition with Gradient-Based Learning book January 1999
Approximation by superpositions of a sigmoidal function journal December 1989
Deep Neural Networks Motivated by Partial Differential Equations journal September 2019
Multilayer feedforward networks are universal approximators journal January 1989
Multilayer feedforward networks with a nonpolynomial activation function can approximate any function journal January 1993
Machine learning of linear differential equations using Gaussian processes journal November 2017
DGM: A deep learning algorithm for solving partial differential equations journal December 2018
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations journal February 2019
Discovering governing equations from data by sparse identification of nonlinear dynamical systems journal March 2016
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification conference December 2015
There exists a neural network that does not make avoidable mistakes conference July 1988
Data-driven discovery of partial differential equations journal April 2017
Long Short-Term Memory journal November 1997

Similar Records

Fourier Neural Networks as Function Approximators and Differential Equation Solvers
Conference · 2021 · OSTI ID:1863256

A unified and constructive framework for the universality of neural networks
Journal Article · 2023 · IMA Journal of Applied Mathematics · OSTI ID:2476752

Short term load forecasting using fuzzy neural networks
Journal Article · 1995 · IEEE Transactions on Power Systems · OSTI ID:163051

Related Subjects