DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Uncertainty quantification in multivariable regression for material property prediction with Bayesian neural networks

Journal Article · · Scientific Reports
 [1];  [1];  [1]; ORCiD logo [2]; ORCiD logo [3];  [1]
  1. Univ. of Idaho, Idaho Falls, ID (United States)
  2. Idaho National Laboratory (INL), Idaho Falls, ID (United States). Nuclear Science & Technology (NS&T)
  3. Idaho National Laboratory (INL), Idaho Falls, ID (United States). Materials & Fuels Complex (MFC)

With the increased use of data-driven approaches and machine learning-based methods in material science, the importance of reliable uncertainty quantification (UQ) of the predicted variables for informed decision-making cannot be overstated. UQ in material property prediction poses unique challenges, including multi-scale and multi-physics nature of materials, intricate interactions between numerous factors, limited availability of large curated datasets, etc. In this work, we introduce a physics-informed Bayesian Neural Networks (BNNs) approach for UQ, which integrates knowledge from governing laws in materials to guide the models toward physically consistent predictions. To evaluate the approach, we present case studies for predicting the creep rupture life of steel alloys. Experimental validation with three datasets of creep tests demonstrates that this method produces point predictions and uncertainty estimations that are competitive or exceed the performance of conventional UQ methods such as Gaussian Process Regression. Additionally, we evaluate the suitability of employing UQ in an active learning scenario and report competitive performance. The most promising framework for creep life prediction is BNNs based on Markov Chain Monte Carlo approximation of the posterior distribution of network parameters, as it provided more reliable results in comparison to BNNs based on variational inference approximation or related NNs with probabilistic outputs.

Research Organization:
Idaho National Laboratory (INL), Idaho Falls, ID (United States)
Sponsoring Organization:
USDOE Laboratory Directed Research and Development (LDRD) Program
Grant/Contract Number:
AC07-05ID14517
OSTI ID:
2371889
Report Number(s):
INL/JOU--24-78018-Rev000
Journal Information:
Scientific Reports, Journal Name: Scientific Reports Journal Issue: 1 Vol. 14; ISSN 2045-2322
Publisher:
Nature Publishing GroupCopyright Statement
Country of Publication:
United States
Language:
English

References (42)

A probabilistic creep model incorporating test condition, initial damage, and material property uncertainty journal October 2021
A survey on instance selection for active learning journal June 2012
A variance maximization criterion for active learning journal June 2018
Uncertainty quantification for Bayesian active learning in rupture life prediction of ferritic steels journal February 2022
Physics-informed machine learning journal May 2021
A physics-informed neural network approach to fatigue life prediction using small quantity of samples journal January 2023
Understanding the Metropolis-Hastings Algorithm journal November 1995
Uncertainty Quantification: Theory, Implementation, and Applications book January 2013
Artificial neural networks for solving ordinary and partial differential equations journal January 1998
A survey of uncertainty in deep neural networks journal July 2023
B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data journal January 2021
Adaptive weighting of Bayesian physics informed neural networks for multitask and multiscale forward and inverse problems journal October 2023
Interpretable Ensemble-Machine-Learning models for predicting creep behavior of concrete journal January 2022
Machine learning assisted interpretation of creep and fatigue life in titanium alloys journal February 2023
Quantile Regression journal November 2001
Bayesian neural networks for uncertainty quantification in data-driven materials modeling journal December 2021
Machine learning augmented predictive and generative model for rupture life in ferritic and austenitic steels journal April 2021
Recent advances and applications of deep learning methods in materials science journal April 2022
Physics-Guided AI for Large-Scale Spatiotemporal Data conference August 2021
Uncertainty Quantification Using Neural Networks for Molecular Property Prediction journal July 2020
Active Learning Query Strategies for Classification, Regression, and Clustering: A Survey journal July 2020
Riemann manifold Langevin and Hamiltonian Monte Carlo methods: Riemann Manifold Langevin and Hamiltonian Monte Carlo Methods journal March 2011
Stacking fault energy of cryogenic austenitic steels journal May 2002
Mapping the creep life of nickel-based SX superalloys in a large compositional space by a two-model linkage machine learning method journal April 2022
Deep learning for AI journal July 2021
A review of uncertainty quantification in deep learning: Techniques, applications and challenges journal December 2021
A machine learning aided interpretable model for rupture strength prediction in Fe-based martensitic and austenitic alloys journal March 2021
Recent progress of uncertainty quantification in small-scale materials science journal April 2021
High-Temperature Inelastic Behavior of the Austenitic Steel AISI Type 316 book January 2013
A defect-based physics-informed machine learning framework for fatigue finite life prediction in additive manufacturing journal October 2022
A tutorial on Gaussian process regression: Modelling, exploring, and exploiting functions journal August 2018
Ensemble deep learning: A review journal October 2022
Bayesian optimization with adaptive surrogate models for automated experimental design journal December 2021
Active learning for logistic regression: an evaluation journal August 2007
Bayesian neural network-based uncertainty modelling: application to soil compressibility and undrained shear strength prediction journal April 2022
Markov Chain Monte Carlo book May 2006
machine. journal October 2001
Machine learning assisted probabilistic creep-fatigue damage assessment journal March 2022
Prediction of creep failure time using machine learning journal October 2020
Active Learning with Statistical Models journal January 1996
A deep learning based life prediction method for components under creep, fatigue and creep-fatigue conditions journal July 2021
A physics-informed neural network for creep-fatigue life prediction of components at elevated temperatures journal December 2021