skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Monotonic Gaussian Process for Physics-Constrained Machine Learning With Materials Science Applications

Journal Article · · Journal of Computing and Information Science in Engineering
DOI:https://doi.org/10.1115/1.4055852· OSTI ID:1887418
 [1];  [1];  [1]
  1. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Physics-constrained machine learning is emerging as an important topic in the field of machine learning for physics. One of the most significant advantages of incorporating physics constraints into machine learning methods is that the resulting model requires significantly less data to train. By incorporating physical rules into the machine learning formulation itself, the predictions are expected to be physically plausible. Gaussian process (GP) is perhaps one of the most common methods in machine learning for small datasets. In this paper, we investigate the possibility of constraining a GP formulation with monotonicity on three different material datasets, where one experimental and two computational datasets are used. The monotonic GP is compared against the regular GP, where a significant reduction in the posterior variance is observed. The monotonic GP is strictly monotonic in the interpolation regime, but in the extrapolation regime, the monotonic effect starts fading away as one goes beyond the training dataset. Imposing monotonicity on the GP comes at a small accuracy cost, compared to the regular GP. The monotonic GP is perhaps most useful in applications where data are scarce and noisy, and monotonicity is supported by strong physical evidence.

Research Organization:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
NA0003525
OSTI ID:
1887418
Report Number(s):
SAND2022-12090J; 709665
Journal Information:
Journal of Computing and Information Science in Engineering, Vol. 23, Issue 1; ISSN 1530-9827
Publisher:
ASMECopyright Statement
Country of Publication:
United States
Language:
English

References (35)

A Survey of Constrained Gaussian Process Regression: Approaches and Implementation Challenges journal January 2020
Identifying Structure–Property Relationships Through DREAM.3D Representative Volume Elements and DAMASK Crystal Plasticity Simulations: An Integrated Computational Materials Engineering Approach journal March 2017
On the Use of Symmetries in Building Surrogate Models journal January 2019
Uncertainty propagation in reduced order models based on crystal plasticity journal June 2020
An active learning high-throughput microstructure calibration framework for solving inverse structure–process problems in materials informatics journal August 2020
Six decades of the Hall–Petch effect – a survey of grain-size strengthening studies on pure metals journal June 2016
Taking the Human Out of the Loop: A Review of Bayesian Optimization journal January 2016
Three-dimensional simulation of grain growth in a thermal gradient with non-uniform grain boundary mobility journal September 2008
Incorporation of deformation twinning in crystal plasticity models journal February 1998
Monotone Emulation of Computer Experiments journal January 2015
Investigation of strain rate behavior of aluminium and AA2024 using crystal plasticity journal January 2022
Extended Co-Kriging interpolation method based on multi-fidelity data journal April 2018
Nonnegativity-enforced Gaussian process regression journal March 2020
Monotonic Metamodels for Deterministic Computer Experiments journal January 2017
Solving Stochastic Inverse Problems for Property–Structure Linkages Using Data-Consistent Inversion and Machine Learning journal November 2020
Gaussian-Process-Driven Adaptive Sampling for Reduced-Order Modeling of Texture Effects in Polycrystalline Alpha-Ti journal June 2019
Application of Gaussian process regression models for capturing the evolution of microstructure statistics in aging of nickel-based superalloys journal October 2019
Efficiently exploiting process-structure-property relationships in material design by multi-information source fusion journal March 2021
Recent progress of uncertainty quantification in small-scale materials science journal April 2021
Further development of the hybrid model for polycrystal deformation journal May 2000
Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization journal December 1997
Revealing the strain-hardening behavior of twinning-induced plasticity steels: Theory, simulations, experiments journal January 2013
DREAM.3D: A Digital Representation Environment for the Analysis of Microstructure in 3D journal April 2014
sMF-BO-2CoGP: A Sequential Multi-Fidelity Constrained Bayesian Optimization Framework for Design Applications journal April 2020
Predicting the Hall–Petch effect in fcc metals using non-local crystal plasticity journal July 2008
Dislocation mechanics of creep journal June 2009
Effects of strain rate on mechanical properties and deformation behavior of an austenitic Fe-25Mn-3Al-3Si TWIP-TRIP steel journal January 2018
Multi-fidelity machine-learning with uncertainty quantification and Bayesian optimization for materials design: Application to ternary random alloys journal August 2020
Solving and learning nonlinear PDEs with Gaussian processes journal December 2021
Application of life-dependent material parameters to lifetime calculation under multiaxial constant- and variable-amplitude loading journal July 2020
Application of the Gaussian process for fatigue life prediction under multiaxial loading journal March 2022
Systems Approaches to Materials Design: Past, Present, and Future journal July 2019
A crystal plasticity model for twinning- and transformation-induced plasticity journal October 2016
DAMASK – The Düsseldorf Advanced Material Simulation Kit for modeling multi-physics crystal plasticity, thermal, and damage phenomena from the single crystal up to the component scale journal February 2019
Computer simulation of normal grain growth in three dimensions journal March 1989