Multi-fidelity machine-learning with uncertainty quantification and Bayesian optimization for materials design: Application to ternary random alloys

Tran, Anh; Tranchida, Julien; Wildey, Tim; Thompson, Aidan P.

doi:10.1063/5.0015672

Multi-fidelity machine-learning with uncertainty quantification and Bayesian optimization for materials design: Application to ternary random alloys

Journal Article · 19 August 2020 · Journal of Chemical Physics

DOI:https://doi.org/10.1063/5.0015672· OSTI ID:1670182

^[1]; ^[1]; ^[1]; ^[1]

Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

We present a scale-bridging approach based on a multi-fidelity (MF) machine-learning (ML) framework leveraging Gaussian processes (GP) to fuse atomistic computational model predictions across multiple levels of fidelity. Through the posterior variance of the MFGP, our framework naturally enables uncertainty quantification, providing estimates of confidence in the predictions. We used density functional theory as high-fidelity prediction, while a ML interatomic potential is used as low-fidelity prediction. Practical materials’ design efficiency is demonstrated by reproducing the ternary composition dependence of a quantity of interest (bulk modulus) across the full aluminum–niobium–titanium ternary random alloy composition space. The MFGP is then coupled to a Bayesian optimization procedure, and the computational efficiency of this approach is demonstrated by performing an on-the-fly search for the global optimum of bulk modulus in the ternary composition space. The framework presented in this manuscript is the first application of MFGP to atomistic materials simulations fusing predictions between density functional theory and classical interatomic potential calculations.

View Accepted Manuscript (DOE)

Research Organization:: Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)

Sponsoring Organization:: USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC04-94AL85000

Other Award/Contract Number:: 17020246
219144

OSTI ID:: 1670182

Report Number(s):: SAND2020-5380J; 686285

Journal Information:: Journal of Chemical Physics, Journal Name: Journal of Chemical Physics Journal Issue: 7 Vol. 153; ISSN 0021-9606

Publisher:: American Institute of Physics (AIP)Copyright Statement

Country of Publication:: United States

Language:: English

References (47)

Fast Parallel Algorithms for Short-Range Molecular Dynamics Plimpton, Steve Journal of Computational Physics, Vol. 117, Issue 1 https://doi.org/10.1006/jcph.1995.1039	journal	March 1995
Constrained mixed-integer Gaussian mixture Bayesian optimization and its applications in designing fractal and auxetic metamaterials Tran, Anh; Tran, Minh; Wang, Yan Structural and Multidisciplinary Optimization, Vol. 59, Issue 6 https://doi.org/10.1007/s00158-018-2182-1	journal	January 2019
Towards an order- Fonseca Guerra, C.; Snijders, J. G.; te Velde, G. Theoretical Chemistry Accounts, Vol. 99, Issue 6 https://doi.org/10.1007/s002140050021	journal	January 1998
Materials Design and Discovery with High-Throughput Density Functional Theory: The Open Quantum Materials Database (OQMD) Saal, James E.; Kirklin, Scott; Aykol, Muratahan JOM, Vol. 65, Issue 11 https://doi.org/10.1007/s11837-013-0755-4	journal	September 2013
Crystal Plasticity Model Calibration for Ti-7Al Alloy with a Multi-fidelity Computational Scheme Acar, Pınar Integrating Materials and Manufacturing Innovation, Vol. 7, Issue 4 https://doi.org/10.1007/s40192-018-0120-0	journal	November 2018
Overview of constitutive laws, kinematics, homogenization and multiscale methods in crystal plasticity finite-element modeling: Theory, experiments, applications Roters, F.; Eisenlohr, P.; Hantcherli, L. Acta Materialia, Vol. 58, Issue 4 https://doi.org/10.1016/j.actamat.2009.10.058	journal	February 2010
Machine learning assisted design of high entropy alloys with desired property Wen, Cheng; Zhang, Yan; Wang, Changxin Acta Materialia, Vol. 170 https://doi.org/10.1016/j.actamat.2019.03.010	journal	May 2019
An active learning high-throughput microstructure calibration framework for solving inverse structure–process problems in materials informatics Tran, Anh; Mitchell, John A.; Swiler, Laura P. Acta Materialia, Vol. 194 https://doi.org/10.1016/j.actamat.2020.04.054	journal	August 2020
Blind Kriging: Implementation and performance analysis Couckuyt, I.; Forrester, A.; Gorissen, D. Advances in Engineering Software, Vol. 49 https://doi.org/10.1016/j.advengsoft.2012.03.002	journal	July 2012
Extended Co-Kriging interpolation method based on multi-fidelity data Xiao, Manyu; Zhang, Guohua; Breitkopf, Piotr Applied Mathematics and Computation, Vol. 323 https://doi.org/10.1016/j.amc.2017.10.055	journal	April 2018
pBO-2GP-3B: A batch parallel known/unknown constrained Bayesian optimization with feasibility classification and its applications in computational fluid dynamics Tran, Anh; Sun, Jing; Furlan, John M. Computer Methods in Applied Mechanics and Engineering, Vol. 347 https://doi.org/10.1016/j.cma.2018.12.033	journal	April 2019
A two-stage multi-fidelity optimization procedure for honeycomb-type cellular materials Sun, Guangyong; Li, Guangyao; Stone, Michael Computational Materials Science, Vol. 49, Issue 3 https://doi.org/10.1016/j.commatsci.2010.05.041	journal	September 2010
Multi-fidelity machine learning models for accurate bandgap predictions of solids Pilania, G.; Gubernatis, J. E.; Lookman, T. Computational Materials Science, Vol. 129 https://doi.org/10.1016/j.commatsci.2016.12.004	journal	March 2017
Fast predictive models based on multi-fidelity sampling of properties in molecular dynamics simulations Razi, M.; Narayan, A.; Kirby, R. M. Computational Materials Science, Vol. 152 https://doi.org/10.1016/j.commatsci.2018.05.029	journal	September 2018
Accelerating high-throughput searches for new alloys with active learning of interatomic potentials Gubaev, Konstantin; Podryabinkin, Evgeny V.; Hart, Gus L. W. Computational Materials Science, Vol. 156 https://doi.org/10.1016/j.commatsci.2018.09.031	journal	January 2019
A multi-fidelity information-fusion approach to machine learn and predict polymer bandgap Patra, Abhirup; Batra, Rohit; Chandrasekaran, Anand Computational Materials Science, Vol. 172 https://doi.org/10.1016/j.commatsci.2019.109286	journal	February 2020
Force-field coefficient optimization of coarse-grained molecular dynamics models with a small computational budget Razi, M.; Narayan, A.; Kirby, R. M. Computational Materials Science, Vol. 176 https://doi.org/10.1016/j.commatsci.2020.109518	journal	April 2020
Spectral neighbor analysis method for automated generation of quantum-accurate interatomic potentials Thompson, A. P.; Swiler, L. P.; Trott, C. R. Journal of Computational Physics, Vol. 285 https://doi.org/10.1016/j.jcp.2014.12.018	journal	March 2015
Massively parallel symplectic algorithm for coupled magnetic spin dynamics and molecular dynamics Tranchida, J.; Plimpton, S. J.; Thibaudeau, P. Journal of Computational Physics, Vol. 372 https://doi.org/10.1016/j.jcp.2018.06.042	journal	November 2018
Nudged Elastic Band Calculations Accelerated with Gaussian Process Regression Based on Inverse Interatomic Distances Koistinen, Olli-Pekka; Ásgeirsson, Vilhjálmur; Vehtari, Aki Journal of Chemical Theory and Computation, Vol. 15, Issue 12 https://doi.org/10.1021/acs.jctc.9b00692	journal	October 2019
Performance and Cost Assessment of Machine Learning Interatomic Potentials Zuo, Yunxing; Chen, Chi; Li, Xiangguo The Journal of Physical Chemistry A, Vol. 124, Issue 4 https://doi.org/10.1021/acs.jpca.9b08723	journal	October 2019
Finite strain isotherm and velocities for single-crystal and polycrystalline NaCl at high pressures and 300°K Birch, Francis Journal of Geophysical Research, Vol. 83, Issue B3, p. 1257-1268 https://doi.org/10.1029/jb083ib03p01257	journal	January 1978
Connecting atomistic and mesoscale simulations of crystal plasticity Bulatov, Vasily; Abraham, Farid F.; Kubin, Ladislas Nature, Vol. 391, Issue 6668 https://doi.org/10.1038/35577	journal	February 1998
Probing the limits of metal plasticity with molecular dynamics simulations Zepeda-Ruiz, Luis A.; Stukowski, Alexander; Oppelstrup, Tomas Nature, Vol. 550, Issue 7677 https://doi.org/10.1038/nature23472	journal	September 2017
Accelerated search for materials with targeted properties by adaptive design Xue, Dezhen; Balachandran, Prasanna V.; Hogden, John Nature Communications, Vol. 7, Issue 1 https://doi.org/10.1038/ncomms11241	journal	April 2016
Machine learning in materials informatics: recent applications and prospects Ramprasad, Rampi; Batra, Rohit; Pilania, Ghanshyam npj Computational Materials, Vol. 3, Issue 1 https://doi.org/10.1038/s41524-017-0056-5	journal	December 2017
Impact of lattice relaxations on phase transitions in a high-entropy alloy studied by machine-learning potentials Kostiuchenko, Tatiana; Körmann, Fritz; Neugebauer, Jörg npj Computational Materials, Vol. 5, Issue 1 https://doi.org/10.1038/s41524-019-0195-y	journal	May 2019
Machine Learning Strategy for Accelerated Design of Polymer Dielectrics Mannodi-Kanakkithodi, Arun; Pilania, Ghanshyam; Huan, Tran Doan Scientific Reports, Vol. 6, Issue 1 https://doi.org/10.1038/srep20952	journal	February 2016
Rungs 1 to 4 of DFT Jacob’s ladder: Extensive test on the lattice constant, bulk modulus, and cohesive energy of solids Tran, Fabien; Stelzl, Julia; Blaha, Peter The Journal of Chemical Physics, Vol. 144, Issue 20 https://doi.org/10.1063/1.4948636	journal	May 2016
QUANTUM ESPRESSO: a modular and open-source software project for quantum simulations of materials Giannozzi, Paolo; Baroni, Stefano; Bonini, Nicola Journal of Physics: Condensed Matter, Vol. 21, Issue 39, Article No. 395502 https://doi.org/10.1088/0953-8984/21/39/395502	journal	September 2009
Designing meaningful density functional theory calculations in materials science—a primer Mattsson, Ann E.; Schultz, Peter A.; Desjarlais, Michael P. Modelling and Simulation in Materials Science and Engineering, Vol. 13, Issue 1 https://doi.org/10.1088/0965-0393/13/1/r01	journal	November 2004
Enabling strain hardening simulations with dislocation dynamics Arsenlis, A.; Cai, W.; Tang, M. Modelling and Simulation in Materials Science and Engineering, Vol. 15, Issue 6 https://doi.org/10.1088/0965-0393/15/6/001	journal	July 2007
Advanced capabilities for materials modelling with Quantum ESPRESSO Giannozzi, P.; Andreussi, O.; Brumme, T. Journal of Physics: Condensed Matter, Vol. 29, Issue 46 https://doi.org/10.1088/1361-648x/aa8f79	journal	October 2017
Roadmap on multiscale materials modeling van der Giessen, Erik; Schultz, Peter A.; Bertin, Nicolas Modelling and Simulation in Materials Science and Engineering, Vol. 28, Issue 4 https://doi.org/10.1088/1361-651x/ab7150	journal	March 2020
Multi-fidelity optimization via surrogate modelling Forrester, Alexander I. J.; Sóbester, András; Keane, Andy J. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 463, Issue 2088 https://doi.org/10.1098/rspa.2007.1900	journal	September 2007
Data-driven material models for atomistic simulation Wood, M. A.; Cusentino, M. A.; Wirth, B. D. Physical Review B, Vol. 99, Issue 18 https://doi.org/10.1103/physrevb.99.184305	journal	May 2019
Hierarchies of Landau-Lifshitz-Bloch equations for nanomagnets: A functional integral framework Tranchida, Julien; Thibaudeau, Pascal; Nicolis, Stam Physical Review E, Vol. 98, Issue 4 https://doi.org/10.1103/physreve.98.042101	journal	October 2018
Gaussian Approximation Potentials: The Accuracy of Quantum Mechanics, without the Electrons Bartók, Albert P.; Payne, Mike C.; Kondor, Risi Physical Review Letters, Vol. 104, Issue 13 https://doi.org/10.1103/physrevlett.104.136403	journal	April 2010
Generalized Gradient Approximation Made Simple Perdew, John P.; Burke, Kieron; Ernzerhof, Matthias Physical Review Letters, Vol. 77, Issue 18, p. 3865-3868 https://doi.org/10.1103/physrevlett.77.3865	journal	October 1996
Accurate force field for molybdenum by machine learning large materials data Chen, Chi; Deng, Zhi; Tran, Richard Physical Review Materials, Vol. 1, Issue 4 https://doi.org/10.1103/physrevmaterials.1.043603	journal	September 2017
Taking the Human Out of the Loop: A Review of Bayesian Optimization Shahriari, Bobak; Swersky, Kevin; Wang, Ziyu Proceedings of the IEEE, Vol. 104, Issue 1 https://doi.org/10.1109/jproc.2015.2494218	journal	January 2016
Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting Srinivas, Niranjan; Krause, Andreas; Kakade, Sham M. IEEE Transactions on Information Theory, Vol. 58, Issue 5 https://doi.org/10.1109/tit.2011.2182033	journal	May 2012
An Efficient First-Principles Saddle Point Searching Method Based on Distributed Kriging Metamodels Tran, Anh; He, Lijuan; Wang, Yan ASCE-ASME J Risk and Uncert in Engrg Sys Part B Mech Engrg, Vol. 4, Issue 1 https://doi.org/10.1115/1.4037459	journal	September 2017
A New Multi-Objective Bayesian Optimization Formulation With the Acquisition Function for Convergence and Diversity Shu, Leshi; Jiang, Ping; Shao, Xinyu Journal of Mechanical Design, Vol. 142, Issue 9 https://doi.org/10.1115/1.4046508	journal	March 2020
sMF-BO-2CoGP: A Sequential Multi-Fidelity Constrained Bayesian Optimization Framework for Design Applications Tran, Anh; Wildey, Tim; McCann, Scott Journal of Computing and Information Science in Engineering, Vol. 20, Issue 3 https://doi.org/10.1115/1.4046697	journal	April 2020
When Bifidelity Meets CoKriging: An Efficient Physics-Informed MultiFidelity Method Yang, Xiu; Zhu, Xueyu; Li, Jing SIAM Journal on Scientific Computing, Vol. 42, Issue 1 https://doi.org/10.1137/18m1231353	journal	January 2020
Finite Deformations of an Elastic Solid Murnaghan, F. D. American Journal of Mathematics, Vol. 59, Issue 2 https://doi.org/10.2307/2371405	journal	April 1937

Similar Records

Bayesian learning of orthogonal embeddings for multi-fidelity Gaussian Processes

Journal Article · 2021 · Computer Methods in Applied Mechanics and Engineering · OSTI ID:1976970

Analysis of the Challenges in Developing Sample-Based Multi-fidelity Estimators for Non-deterministic Models

Journal Article · 2024 · International Journal for Uncertainty Quantification · OSTI ID:2351026

Fast increased fidelity samplers for approximate Bayesian Gaussian process regression

Journal Article · 2022 · Journal of the Royal Statistical Society: Series B (Statistical Methodology) · OSTI ID:1876804

Related Subjects

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY
Machine Learning Meets Chemical Physics

Multi-fidelity machine-learning with uncertainty quantification and Bayesian optimization for materials design: Application to ternary random alloys

Citation Formats

References (47)

Similar Records

Related Subjects