Monotonic Gaussian Process for Physics-Constrained Machine Learning With Materials Science Applications

Tran, Anh; Maupin, Kathryn; Rodgers, Theron

doi:10.1115/1.4055852

Monotonic Gaussian Process for Physics-Constrained Machine Learning With Materials Science Applications

Journal Article · 20 October 2022 · Journal of Computing and Information Science in Engineering

DOI:https://doi.org/10.1115/1.4055852· OSTI ID:1887418

Tran, Anh ^[1]; Maupin, Kathryn ^[1]; Rodgers, Theron ^[1]

Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Physics-constrained machine learning is emerging as an important topic in the field of machine learning for physics. One of the most significant advantages of incorporating physics constraints into machine learning methods is that the resulting model requires significantly less data to train. By incorporating physical rules into the machine learning formulation itself, the predictions are expected to be physically plausible. Gaussian process (GP) is perhaps one of the most common methods in machine learning for small datasets. In this paper, we investigate the possibility of constraining a GP formulation with monotonicity on three different material datasets, where one experimental and two computational datasets are used. The monotonic GP is compared against the regular GP, where a significant reduction in the posterior variance is observed. The monotonic GP is strictly monotonic in the interpolation regime, but in the extrapolation regime, the monotonic effect starts fading away as one goes beyond the training dataset. Imposing monotonicity on the GP comes at a small accuracy cost, compared to the regular GP. The monotonic GP is perhaps most useful in applications where data are scarce and noisy, and monotonicity is supported by strong physical evidence.

View Accepted Manuscript (DOE)

Research Organization:: Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: NA0003525

OSTI ID:: 1887418

Report Number(s):: SAND2022-12090J; 709665

Journal Information:: Journal of Computing and Information Science in Engineering, Vol. 23, Issue 1; ISSN 1530-9827

Publisher:: ASMECopyright Statement

Country of Publication:: United States

Language:: English

References (36)

A Survey of Constrained Gaussian Process Regression: Approaches and Implementation Challenges Swiler, Laura P.; Gulian, Mamikon; Frankel, Ari L. Journal of Machine Learning for Modeling and Computing, Vol. 1, Issue 2 https://doi.org/10.1615/JMachLearnModelComput.2020035155	journal	January 2020
Identifying Structure–Property Relationships Through DREAM.3D Representative Volume Elements and DAMASK Crystal Plasticity Simulations: An Integrated Computational Materials Engineering Approach Diehl, Martin; Groeber, Michael; Haase, Christian JOM, Vol. 69, Issue 5 https://doi.org/10.1007/s11837-017-2303-0	journal	March 2017
On the Use of Symmetries in Building Surrogate Models Giselle Fernández-Godino, M.; Balachandar, S.; Haftka, Raphael T. Journal of Mechanical Design, Vol. 141, Issue 6 https://doi.org/10.1115/1.4042047	journal	January 2019
Uncertainty propagation in reduced order models based on crystal plasticity Tallman, Aaron E.; Swiler, Laura P.; Wang, Yan Computer Methods in Applied Mechanics and Engineering, Vol. 365 https://doi.org/10.1016/j.cma.2020.113009	journal	June 2020
An active learning high-throughput microstructure calibration framework for solving inverse structure–process problems in materials informatics Tran, Anh; Mitchell, John A.; Swiler, Laura P. Acta Materialia, Vol. 194 https://doi.org/10.1016/j.actamat.2020.04.054	journal	August 2020
Six decades of the Hall–Petch effect – a survey of grain-size strengthening studies on pure metals Cordero, Z. C.; Knight, B. E.; Schuh, C. A. International Materials Reviews, Vol. 61, Issue 8 https://doi.org/10.1080/09506608.2016.1191808	journal	June 2016
Taking the Human Out of the Loop: A Review of Bayesian Optimization Shahriari, Bobak; Swersky, Kevin; Wang, Ziyu Proceedings of the IEEE, Vol. 104, Issue 1 https://doi.org/10.1109/JPROC.2015.2494218	journal	January 2016
Three-dimensional simulation of grain growth in a thermal gradient with non-uniform grain boundary mobility Garcia, A.; Tikare, V.; Holm, E. Scripta Materialia, Vol. 59, Issue 6 https://doi.org/10.1016/j.scriptamat.2008.05.039	journal	September 2008
Incorporation of deformation twinning in crystal plasticity models Kalidindi, Surya R. Journal of the Mechanics and Physics of Solids, Vol. 46, Issue 2 https://doi.org/10.1016/S0022-5096(97)00051-3	journal	February 1998
Monotone Emulation of Computer Experiments Golchi, S.; Bingham, D. R.; Chipman, H. SIAM/ASA Journal on Uncertainty Quantification, Vol. 3, Issue 1 https://doi.org/10.1137/140976741	journal	January 2015
Investigation of strain rate behavior of aluminium and AA2024 using crystal plasticity Singh, Lakhwinder; Vohra, Sanjay; Sharma, Manu Materials Today: Proceedings, Vol. 50 https://doi.org/10.1016/j.matpr.2021.10.232	journal	January 2022
Extended Co-Kriging interpolation method based on multi-fidelity data Xiao, Manyu; Zhang, Guohua; Breitkopf, Piotr Applied Mathematics and Computation, Vol. 323 https://doi.org/10.1016/j.amc.2017.10.055	journal	April 2018
Nonnegativity-enforced Gaussian process regression Pensoneault, Andrew; Yang, Xiu; Zhu, Xueyu Theoretical and Applied Mechanics Letters, Vol. 10, Issue 3 https://doi.org/10.1016/j.taml.2020.01.036	journal	March 2020
Monotonic Metamodels for Deterministic Computer Experiments Tan, Matthias Hwai Yong Technometrics, Vol. 59, Issue 1 https://doi.org/10.1080/00401706.2015.1105759	journal	January 2017
Solving Stochastic Inverse Problems for Property–Structure Linkages Using Data-Consistent Inversion and Machine Learning Tran, Anh; Wildey, Tim JOM, Vol. 73, Issue 1 https://doi.org/10.1007/s11837-020-04432-w	journal	November 2020
Gaussian-Process-Driven Adaptive Sampling for Reduced-Order Modeling of Texture Effects in Polycrystalline Alpha-Ti Tallman, Aaron E.; Stopka, Krzysztof S.; Swiler, Laura P. JOM, Vol. 71, Issue 8 https://doi.org/10.1007/s11837-019-03553-1	journal	June 2019
Application of Gaussian process regression models for capturing the evolution of microstructure statistics in aging of nickel-based superalloys Yabansu, Yuksel C.; Iskakov, Almambet; Kapustina, Anna Acta Materialia, Vol. 178 https://doi.org/10.1016/j.actamat.2019.07.048	journal	October 2019
Efficiently exploiting process-structure-property relationships in material design by multi-information source fusion Khatamsaz, Danial; Molkeri, Abhilash; Couperthwaite, Richard Acta Materialia, Vol. 206 https://doi.org/10.1016/j.actamat.2020.116619	journal	March 2021
Recent progress of uncertainty quantification in small-scale materials science Acar, Pınar Progress in Materials Science, Vol. 117 https://doi.org/10.1016/j.pmatsci.2020.100723	journal	April 2021
Further development of the hybrid model for polycrystal deformation Fernandes, J. V.; Vieira, M. F. Acta Materialia, Vol. 48, Issue 8 https://doi.org/10.1016/S1359-6454(99)00466-8	journal	May 2000
Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization Zhu, Ciyou; Byrd, Richard H.; Lu, Peihuang ACM Transactions on Mathematical Software, Vol. 23, Issue 4 https://doi.org/10.1145/279232.279236	journal	December 1997
Revealing the strain-hardening behavior of twinning-induced plasticity steels: Theory, simulations, experiments Steinmetz, David R.; Jäpel, Tom; Wietbrock, Burkhard Acta Materialia, Vol. 61, Issue 2 https://doi.org/10.1016/j.actamat.2012.09.064	journal	January 2013
DREAM.3D: A Digital Representation Environment for the Analysis of Microstructure in 3D Groeber, Michael A.; Jackson, Michael A. Integrating Materials and Manufacturing Innovation, Vol. 3, Issue 1 https://doi.org/10.1186/2193-9772-3-5	journal	April 2014
sMF-BO-2CoGP: A Sequential Multi-Fidelity Constrained Bayesian Optimization Framework for Design Applications Tran, Anh; Wildey, Tim; McCann, Scott Journal of Computing and Information Science in Engineering, Vol. 20, Issue 3 https://doi.org/10.1115/1.4046697	journal	April 2020
Predicting the Hall–Petch effect in fcc metals using non-local crystal plasticity Counts, William A.; Braginsky, Michael V.; Battaile, Corbett C. International Journal of Plasticity, Vol. 24, Issue 7 https://doi.org/10.1016/j.ijplas.2007.09.008	journal	July 2008
Dislocation mechanics of creep Blum, W.; Eisenlohr, P. Materials Science and Engineering: A, Vol. 510-511 https://doi.org/10.1016/j.msea.2008.04.110	journal	June 2009
Effects of strain rate on mechanical properties and deformation behavior of an austenitic Fe-25Mn-3Al-3Si TWIP-TRIP steel Benzing, J. T.; Poling, W. A.; Pierce, D. T. Materials Science and Engineering: A, Vol. 711 https://doi.org/10.1016/j.msea.2017.11.017	journal	January 2018
Multi-fidelity machine-learning with uncertainty quantification and Bayesian optimization for materials design: Application to ternary random alloys Tran, Anh; Tranchida, Julien; Wildey, Tim The Journal of Chemical Physics, Vol. 153, Issue 7 https://doi.org/10.1063/5.0015672	journal	August 2020
Solving and learning nonlinear PDEs with Gaussian processes Chen, Yifan; Hosseini, Bamdad; Owhadi, Houman Journal of Computational Physics, Vol. 447 https://doi.org/10.1016/j.jcp.2021.110668	journal	December 2021
Application of life-dependent material parameters to lifetime calculation under multiaxial constant- and variable-amplitude loading Karolczuk, Aleksander; Kluger, Krzysztof International Journal of Fatigue, Vol. 136 https://doi.org/10.1016/j.ijfatigue.2020.105625	journal	July 2020
Application of the Gaussian process for fatigue life prediction under multiaxial loading Karolczuk, Aleksander; Słoński, Marek Mechanical Systems and Signal Processing, Vol. 167 https://doi.org/10.1016/j.ymssp.2021.108599	journal	March 2022
Systems Approaches to Materials Design: Past, Present, and Future Arróyave, Raymundo; McDowell, David L. Annual Review of Materials Research, Vol. 49, Issue 1 https://doi.org/10.1146/annurev-matsci-070218-125955	journal	July 2019
A crystal plasticity model for twinning- and transformation-induced plasticity Wong, Su Leen; Madivala, Manjunatha; Prahl, Ulrich Acta Materialia, Vol. 118 https://doi.org/10.1016/j.actamat.2016.07.032	journal	October 2016
DAMASK – The Düsseldorf Advanced Material Simulation Kit for modeling multi-physics crystal plasticity, thermal, and damage phenomena from the single crystal up to the component scale Roters, F.; Diehl, M.; Shanthraj, P. Computational Materials Science, Vol. 158 https://doi.org/10.1016/j.commatsci.2018.04.030	journal	February 2019
Computer simulation of normal grain growth in three dimensions Anderson, M. P.; Grest, G. S.; Srolovitz, D. J. Philosophical Magazine B, Vol. 59, Issue 3 https://doi.org/10.1080/13642818908220181	journal	March 1989
Data for: Application of life-dependent material parameters to lifetime calculation under multiaxial constant- and variable-amplitude loading Karolczuk, Aleksander Mendeley https://doi.org/10.17632/4tkphyg457	dataset	January 2020

Similar Records

Gaussian processes with built-in dimensionality reduction: Applications to high-dimensional uncertainty propagation

Journal Article · 2016 · Journal of Computational Physics · OSTI ID:22572346

Tripathy, Rohit; Bilionis, Ilias; Gonzalez, Marcial

Multi-View Budgeted Learning under Label and Feature Constraints Using Label-Guided Graph-Based Regularization

Conference · 2011 · OSTI ID:1018622

Symons, Christopher T; Arel, Itamar

Related Subjects

97 MATHEMATICS AND COMPUTING
36 MATERIALS SCIENCE
Machine Intelligence for Engineering Under Uncertainties
artificial intelligence
data-driven engineering
engineering informatics
machine learning for engineering applications
multiphysics modeling and simulation
machine learning
materials science
physics
stress
testing
crystals
plasticity
simulation
noise (Sound)
finite element analysis
interpolation

Monotonic Gaussian Process for Physics-Constrained Machine Learning With Materials Science Applications

Citation Formats

References (36)

Similar Records

Related Subjects