DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Equation Discovery Using Fast Function Extraction: a Deterministic Symbolic Regression Approach

Journal Article · · Fluids
 [1]; ORCiD logo [2]
  1. Oklahoma State Univ., Stillwater, OK (United States); Oklahoma State University Stillwater
  2. Oklahoma State Univ., Stillwater, OK (United States)

Advances in machine learning (ML) coupled with increased computational power have enabled identification of patterns in data extracted from complex systems. ML algorithms are actively being sought in recovering physical models or mathematical equations from data. This is a highly valuable technique where models cannot be built using physical reasoning alone. In this paper, we investigate the application of fast function extraction (FFX), a fast, scalable, deterministic symbolic regression algorithm to recover partial differential equations (PDEs). FFX identifies active bases among a huge set of candidate basis functions and their corresponding coefficients from recorded snapshot data. This approach uses a sparsity-promoting technique from compressive sensing and sparse optimization called pathwise regularized learning to perform feature selection and parameter estimation. Furthermore, it recovers several models of varying complexity (number of basis terms). FFX finally filters out many identified models using non-dominated sorting and forms a Pareto front consisting of optimal models with respect to minimizing complexity and test accuracy. Numerical experiments are carried out to recover several ubiquitous PDEs such as wave and heat equations among linear PDEs and Burgers, Korteweg–de Vries (KdV), and Kawahara equations among higher-order nonlinear PDEs. Additional simulations are conducted on the same PDEs under noisy conditions to test the robustness of the proposed approach.

Research Organization:
Oklahoma State Univ., Stillwater, OK (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
Grant/Contract Number:
SC0019290
OSTI ID:
1593572
Journal Information:
Fluids, Journal Name: Fluids Journal Issue: 2 Vol. 4; ISSN 2311-5521; ISSN FLUICM
Publisher:
MDPICopyright Statement
Country of Publication:
United States
Language:
English

References (47)

Stable signal recovery from incomplete and inaccurate measurements
  • Candès, Emmanuel J.; Romberg, Justin K.; Tao, Terence
  • Communications on Pure and Applied Mathematics, Vol. 59, Issue 8, p. 1207-1223 https://doi.org/10.1002/cpa.20124
journal January 2006
Force identification of dynamic systems using genetic programming journal January 2005
The application of robust Bayesian analysis to hypothesis testing and Occam's Razor journal February 1992
The Roles of Plastic Surgeons in Advancing Artificial Intelligence in Plastic Surgery journal April 2021
Deep Representational Similarity Learning for Analyzing Neural Signatures in Task-based fMRI Dataset journal October 2020
Occam's Razor journal April 1987
Existence of perturbed solitary wave solutions to a model equation for water waves journal September 1988
New exact travelling wave solutions for the Kawahara and modified Kawahara equations journal January 2004
Parse-matrix evolution for symbolic regression journal September 2012
A novel evolutionary algorithm applied to algebraic modifications of the RANS stress–strain relationship journal November 2016
Application of an evolutionary algorithm to LES modelling of turbulent transport in premixed flames journal December 2018
Compressed Sensing book May 2012
Closed-loop separation control using machine learning journal April 2015
The perceptron: A probabilistic model for information storage and organization in the brain. journal January 1958
The big challenges of big data journal June 2013
Deep learning journal May 2015
Machine learning identifies a strong association between warming and reduced primary productivity in an oligotrophic ocean gyre journal February 2020
Multi-objective genetic programming for nonlinear system identification journal January 1998
Sparse dynamics for partial differential equations journal March 2013
Discovering governing equations from data by sparse identification of nonlinear dynamical systems journal March 2016
Generalized Linear Models journal December 2000
Learning partial differential equations via data discovery and sparse optimization journal January 2017
Model selection for dynamical systems via sparse regression and information criteria journal August 2017
Prediction of dynamical systems by symbolic regression journal July 2016
A fast and elitist multiobjective genetic algorithm: NSGA-II journal April 2002
An Introduction To Compressive Sampling journal March 2008
Compressed sensing journal April 2006
Regularization and variable selection via the elastic net journal April 2005
Regression Shrinkage and Selection Via the Lasso journal January 1996
Closed-Loop Turbulence Control: Progress and Challenges journal August 2015
Data-driven discovery of partial differential equations journal April 2017
Distilling Free-Form Natural Laws from Experimental Data journal April 2009
Machine learning: Trends, perspectives, and prospects journal July 2015
Exact Recovery of Chaotic Systems from Highly Corrupted Data journal January 2017
Extracting Sparse High-Dimensional Dynamics from Limited Data journal January 2018
Oscillatory Solitary Waves in Dispersive Media journal July 1972
Nonlinear Interaction between Short and Long Capillary-Gravity Waves journal November 1975
Occam's Razor journal May 1940
Regularization Paths for Generalized Linear Models via Coordinate Descent journal January 2010
Circulating Proteomic Signature of Early Death in Heart Failure Patients with Reduced Ejection Fraction journal January 2019
Generalized Linear Models journal January 1972
Deep Reinforcement Learning framework for Autonomous Driving journal January 2017
Extreme Learning Machines as Encoders for Sparse Reconstruction journal November 2018
Discovering governing equations from data: Sparse identification of nonlinear dynamical systems text January 2015
Prediction of Dynamical Systems by Symbolic Regression text January 2016
Data-driven discovery of partial differential equations preprint January 2016
Deep Learning text January 2018

Cited By (1)

Feature engineering and symbolic regression methods for detecting hidden physics from sparse sensor observation data journal January 2020