Multi-fidelity Bayesian neural networks: Algorithms and applications

Meng, Xuhui; Babaee, Hessam; Karniadakis, George Em

doi:10.1016/j.jcp.2021.110361

Title: Multi-fidelity Bayesian neural networks: Algorithms and applications

Authors:: Meng, Xuhui; Babaee, Hessam; Karniadakis, George Em

Publication Date:: 2021-08-01

Sponsoring Org.:: USDOE

OSTI Identifier:: 1781852

Grant/Contract Number:: SC0019453

Resource Type:: Publisher's Accepted Manuscript

Journal Name:: Journal of Computational Physics

Additional Journal Information:: Journal Name: Journal of Computational Physics Journal Volume: 438 Journal Issue: C; Journal ID: ISSN 0021-9991

Publisher:: Elsevier

Country of Publication:: United States

Language:: English

Citation Formats


                    Meng, Xuhui, Babaee, Hessam, and Karniadakis, George Em. Multi-fidelity Bayesian neural networks: Algorithms and applications.  United States: N. p., 2021. 
Web.  doi:10.1016/j.jcp.2021.110361.

Copy to clipboard


                    Meng, Xuhui, Babaee, Hessam, & Karniadakis, George Em. Multi-fidelity Bayesian neural networks: Algorithms and applications.  United States.  https://doi.org/10.1016/j.jcp.2021.110361

Copy to clipboard


                    Meng, Xuhui, Babaee, Hessam, and Karniadakis, George Em. Sun .  
"Multi-fidelity Bayesian neural networks: Algorithms and applications".  United States.  https://doi.org/10.1016/j.jcp.2021.110361.

Copy to clipboard


                    
@article{osti_1781852,

  title        = {Multi-fidelity Bayesian neural networks: Algorithms and applications},

  author       = {Meng, Xuhui and Babaee, Hessam and Karniadakis, George Em},

  abstractNote = {},

  doi          = {10.1016/j.jcp.2021.110361},

  journal      = {Journal of Computational Physics},

  number       = C,

  volume       = 438,

  place        = {United States},

  year         = {2021},

  month        = {8}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (Publisher)

Publisher's Version of Record
https://doi.org/10.1016/j.jcp.2021.110361

Other availability

Search WorldCat to find libraries that may hold this journal

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

Model inversion via multi-fidelity Bayesian optimization: a new paradigm for parameter estimation in haemodynamics, and beyond
journal, May 2016

Perdikaris, Paris; Karniadakis, George Em
Journal of The Royal Society Interface, Vol. 13, Issue 118
DOI: 10.1098/rsif.2015.1107

A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems
journal, January 2020

Meng, Xuhui; Karniadakis, George Em
Journal of Computational Physics, Vol. 401
DOI: 10.1016/j.jcp.2019.109020

A Multifidelity Framework and Uncertainty Quantification for Sea Surface Temperature in the Massachusetts and Cape Cod Bays
journal, February 2020

Babaee, H.; Bastidas, C.; DeFilippo, M.
Earth and Space Science, Vol. 7, Issue 2
DOI: 10.1029/2019EA000954

Learning properties of ordered and disordered materials from multi-fidelity data
journal, January 2021

Chen, Chi; Zuo, Yunxing; Ye, Weike
Nature Computational Science, Vol. 1, Issue 1
DOI: 10.1038/s43588-020-00002-x

Neural-net-induced Gaussian process regression for function approximation and PDE solution
journal, May 2019

Pang, Guofei; Yang, Liu; Karniadakis, George Em
Journal of Computational Physics, Vol. 384
DOI: 10.1016/j.jcp.2019.01.045

Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization
journal, January 2018

Peherstorfer, Benjamin; Willcox, Karen; Gunzburger, Max
SIAM Review, Vol. 60, Issue 3
DOI: 10.1137/16M1082469

Bifidelity Data-Assisted Neural Networks in Nonintrusive Reduced-Order Modeling
journal, February 2021

Lu, Chuan; Zhu, Xueyu
Journal of Scientific Computing, Vol. 87, Issue 1
DOI: 10.1007/s10915-020-01403-w

Generalized ocean color inversion model for retrieving marine inherent optical properties
journal, January 2013

Werdell, P. Jeremy; Franz, Bryan A.; Bailey, Sean W.
Applied Optics, Vol. 52, Issue 10
DOI: 10.1364/AO.52.002019

Optimization of Forcing Parameters of Film Cooling Effectiveness
journal, November 2013

Babaee, Hessam; Acharya, Sumanta; Wan, Xiaoliang
Journal of Turbomachinery, Vol. 136, Issue 6
DOI: 10.1115/1.4025732

Inferring solutions of differential equations using noisy multi-fidelity data
journal, April 2017

Raissi, Maziar; Perdikaris, Paris; Karniadakis, George Em
Journal of Computational Physics, Vol. 335
DOI: 10.1016/j.jcp.2017.01.060

An Adaptive Surrogate Modeling Based on Deep Neural Networks for Large-Scale Bayesian Inverse Problems
journal, June 2020

Zhou, Liang Yan & Tao
Communications in Computational Physics, Vol. 28, Issue 5
DOI: 10.4208/cicp.OA-2020-0186

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
journal, February 2019

Raissi, M.; Perdikaris, P.; Karniadakis, G. E.
Journal of Computational Physics, Vol. 378
DOI: 10.1016/j.jcp.2018.10.045

A Bayesian exploration-exploitation approach for optimal online sensing and planning with a visually guided mobile robot
journal, August 2009

Martinez-Cantin, Ruben; de Freitas, Nando; Brochu, Eric
Autonomous Robots, Vol. 27, Issue 2
DOI: 10.1007/s10514-009-9130-2

Predicting the output from a complex computer code when fast approximations are available
journal, March 2000

Kennedy, M.
Biometrika, Vol. 87, Issue 1
DOI: 10.1093/biomet/87.1.1

B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data
journal, January 2021

Yang, Liu; Meng, Xuhui; Karniadakis, George Em
Journal of Computational Physics, Vol. 425
DOI: 10.1016/j.jcp.2020.109913

Multi-fidelity modelling of mixed convection based on experimental correlations and numerical simulations
journal, November 2016

Babaee, H.; Perdikaris, P.; Chryssostomidis, C.
Journal of Fluid Mechanics, Vol. 809
DOI: 10.1017/jfm.2016.718

Similar Records in DOE PAGES and OSTI.GOV collections:

A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems

Journal Article Meng, Xuhui ; Karniadakis, George Em - Journal of Computational Physics

Presently the training of neural networks relies on data of comparable accuracy but in real applications only a very small set of high-fidelity data is available while inexpensive lower fidelity data may be plentiful. We propose a new composite neural network (NN) that can be trained based on multi-fidelity data. It is comprised of three NNs, with the first NN trained using the low-fidelity data and coupled to two high-fidelity NNs, one with activation functions and another one without, in order to discover and exploit nonlinear and linear correlations, respectively, between the low-fidelity and the high-fidelity data. We first demonstratemore »« less
Cited by 129
https://doi.org/10.1016/j.jcp.2019.109020

Full Text Available
A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems

Journal Article Meng, Xuhui ; Karniadakis, George E. - Journal of Computational Physics

Currently the training of neural networks relies on data of comparable accuracy but in real applications only a very small set of high-fidelity data is available while inexpensive lower fidelity data may be plentiful. We propose a new composite neural network (NN) that can be trained based on multi-fidelity data. It is comprised of three NNs, with the first NN trained using the low-fidelity data and coupled to two high-fidelity NNs, one with activation functions and another one without, in order to discover and exploit nonlinear and linear correlations, respectively, between the low-fidelity and the high-fidelity data. We first demonstratemore »« less
https://doi.org/10.1016/j.jcp.2019.109020
Scalable algorithms for physics-informed neural and graph networks

Journal Article Shukla, Khemraj ; Xu, Mengjia ; Trask, Nathaniel ; ... - Data-Centric Engineering

Physics-informed machine learning (PIML) has emerged as a promising new approach for simulating complex physical and biological systems that are governed by complex multiscale processes for which some data are also available. In some instances, the objective is to discover part of the hidden physics from the available data, and PIML has been shown to be particularly effective for such problems for which conventional methods may fail. Unlike commercial machine learning where training of deep neural networks requires big data, in PIML big data are not available. Instead, we can train such networks from additional information obtained by employing themore »« less
https://doi.org/10.1017/dce.2022.24

Full Text Available
Multi-fidelity modeling to predict the rheological properties of a suspension of fibers using neural networks and Gaussian processes

Journal Article Boodaghidizaji, Miad ; Khan, Monsurul ; Ardekani, Arezoo M. - Physics of Fluids

Unveiling the rheological properties of fiber suspensions is of paramount interest to many industrial applications. There are multiple factors, such as fiber aspect ratio and volume fraction, that play a significant role in altering the rheological behavior of suspensions. Three-dimensional (3D) numerical simulations of coupled differential equations of the suspension of fibers are computationally expensive and time-consuming. Machine learning algorithms can be trained on the available data and make predictions for the cases where no numerical data are available. However, some widely used machine learning surrogates, such as neural networks, require a relatively large training dataset to produce accurate predictions.more »« less
https://doi.org/10.1063/5.0087449
Multi-fidelity information fusion with concatenated neural networks

Journal Article Pawar, Suraj ; San, Omer ; Vedula, Prakash ; ... - Scientific Reports

Recently, computational modeling has shifted towards the use of statistical inference, deep learning, and other data-driven modeling frameworks. Although this shift in modeling holds promise in many applications like design optimization and real-time control by lowering the computational burden, training deep learning models needs a huge amount of data. This big data is not always available for scientific problems and leads to poorly generalizable data-driven models. This gap can be furnished by leveraging information from physics-based models. Exploiting prior knowledge about the problem at hand, this study puts forth a physics-guided machine learning (PGML) approach to build more tailored, effective,more »« less
https://doi.org/10.1038/s41598-022-09938-8

Full Text Available

Similar Records

Title: Multi-fidelity Bayesian neural networks: Algorithms and applications

Citation Formats

Model inversion via multi-fidelity Bayesian optimization: a new paradigm for parameter estimation in haemodynamics, and beyond journal, May 2016

A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems journal, January 2020

A Multifidelity Framework and Uncertainty Quantification for Sea Surface Temperature in the Massachusetts and Cape Cod Bays journal, February 2020

Learning properties of ordered and disordered materials from multi-fidelity data journal, January 2021

Neural-net-induced Gaussian process regression for function approximation and PDE solution journal, May 2019

Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization journal, January 2018

Bifidelity Data-Assisted Neural Networks in Nonintrusive Reduced-Order Modeling journal, February 2021

Generalized ocean color inversion model for retrieving marine inherent optical properties journal, January 2013

Optimization of Forcing Parameters of Film Cooling Effectiveness journal, November 2013

Inferring solutions of differential equations using noisy multi-fidelity data journal, April 2017

An Adaptive Surrogate Modeling Based on Deep Neural Networks for Large-Scale Bayesian Inverse Problems journal, June 2020

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations journal, February 2019

A Bayesian exploration-exploitation approach for optimal online sensing and planning with a visually guided mobile robot journal, August 2009

Predicting the output from a complex computer code when fast approximations are available journal, March 2000

B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data journal, January 2021

Multi-fidelity modelling of mixed convection based on experimental correlations and numerical simulations journal, November 2016

Model inversion via multi-fidelity Bayesian optimization: a new paradigm for parameter estimation in haemodynamics, and beyond
journal, May 2016

A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems
journal, January 2020

A Multifidelity Framework and Uncertainty Quantification for Sea Surface Temperature in the Massachusetts and Cape Cod Bays
journal, February 2020

Learning properties of ordered and disordered materials from multi-fidelity data
journal, January 2021

Neural-net-induced Gaussian process regression for function approximation and PDE solution
journal, May 2019

Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization
journal, January 2018

Bifidelity Data-Assisted Neural Networks in Nonintrusive Reduced-Order Modeling
journal, February 2021

Generalized ocean color inversion model for retrieving marine inherent optical properties
journal, January 2013

Optimization of Forcing Parameters of Film Cooling Effectiveness
journal, November 2013

Inferring solutions of differential equations using noisy multi-fidelity data
journal, April 2017

An Adaptive Surrogate Modeling Based on Deep Neural Networks for Large-Scale Bayesian Inverse Problems
journal, June 2020

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
journal, February 2019

A Bayesian exploration-exploitation approach for optimal online sensing and planning with a visually guided mobile robot
journal, August 2009

Predicting the output from a complex computer code when fast approximations are available
journal, March 2000

B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data
journal, January 2021

Multi-fidelity modelling of mixed convection based on experimental correlations and numerical simulations
journal, November 2016