Title: A Continuous Action Space Tree search for INverse desiGn (CASTING) framework for materials discovery

Journal Article · · npj Computational Materials

Abstract Material properties share an intrinsic relationship with their structural attributes, making inverse design approaches crucial for discovering new materials with desired functionalities. Reinforcement Learning (RL) approaches are emerging as powerful inverse design tools, often functioning in discrete action spaces. This constrains their application in materials design problems, which involve continuous search spaces. Here, we introduce an RL-based framework CASTING (Continuous Action Space Tree Search for inverse design), that employs a decision tree-based Monte Carlo Tree Search (MCTS) algorithm with continuous space adaptation through modified policies and sampling. Using representative examples like Silver (Ag) for metals, Carbon (C) for covalent systems, and multicomponent systems such as graphane, boron nitride, and complex correlated oxides, we showcase its accuracy, convergence speed, and scalability in materials discovery and design. Furthermore, with the inverse design of super-hard Carbon phases, we demonstrate CASTING’s utility in discovering metastable phases tailored to user-defined target properties and preferences.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States); Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
Air Force Office of Scientific Research (AFOSR); US Air Force Office of Scientific Research (AFOSR); USDOE; USDOE Office of Science (SC), Basic Energy Sciences (BES); USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities (SUF)
Grant/Contract Number:
AC02-05CH11231; AC02-06CH11357
OSTI ID:
2007113
Journal Information:
npj Computational Materials, Journal Name: npj Computational Materials Journal Issue: 1 Vol. 9; ISSN 2057-3960
Publisher:
Nature Publishing GroupCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (85)

Modern Methods of Crystal Structure Prediction book November 2010
Pressure Induced Unstable Electronic States upon Correlated Nickelates Metastable Perovskites as Batch Synthesized via Heterogeneous Nucleation journal April 2020
Ultrasmall Au10−12(SG)10−12Nanomolecules for High Tumor Specificity and Cancer Radiotherapy journal May 2014
Strain Engineering of 2D Materials: Issues and Opportunities at the Interface journal January 2019
Fast Parallel Algorithms for Short-Range Molecular Dynamics journal March 1995
Simulated annealing book January 1987
A genetic algorithm tutorial journal June 1994
Ward’s Hierarchical Agglomerative Clustering Method: Which Algorithms Implement Ward’s Criterion? journal October 2014
Measuring the curse of dimensionality and its effects on particle swarm optimization and differential evolution journal November 2014
A Review on Functionalized Gold Nanoparticles for Biosensing Applications journal April 2011
Surface and bulk properties of metals modelled with Sutton-Chen potentials journal January 1993
XtalOpt: An open-source evolutionary algorithm for crystal structure prediction journal February 2011
CALYPSO: A method for crystal structure prediction journal October 2012
Lonsdaleite – A material stronger and stiffer than diamond journal August 2011
Pressure-induced phase transformation in β-eucryptite: An X-ray diffraction and density functional theory study journal September 2016
Industrial applications of superhard nanocomposite coatings journal July 2008
Atomically Precise Clusters of Noble Metals: Emerging Link between Atoms and Nanoparticles journal June 2017
Exploring Two-Dimensional Materials toward the Next-Generation Circuits: From Monomer Design to Assembly Control journal January 2018
Germanium Dumbbells in a New Superconducting Modification of BaGe 3 journal April 2016
Learning with Delayed Rewards—A Case Study on Inverse Defect Design in 2D Materials journal July 2021
Unusual High Hardness and Load-Dependent Mechanical Characteristics of Hydrogenated Carbon–Nitrogen Hybrid Films journal April 2022
Artificial Intelligence-Guided De Novo Molecular Design Targeting COVID-19 journal May 2021
Quantitative Structure–Property Relationship Modeling of Diverse Materials Properties journal January 2012
Challenges for Density Functional Theory journal December 2011
Crystal Structure Prediction via Deep Learning journal June 2018
Global Optimization by Basin-Hopping and the Lowest Energy Structures of Lennard-Jones Clusters Containing up to 110 Atoms journal July 1997
The New Skinny in Two-Dimensional Nanomaterials journal May 2013
Lonsdaleite, a Hexagonal Polymorph of Diamond journal May 1967
Prediction of crystal structures from crystal chemistry rules by simulated annealing journal July 1990
Meet the crystal growers who sparked a revolution in graphene electronics journal August 2019
Van der Waals heterostructures journal July 2013
Mastering the game of Go with deep neural networks and tree search journal January 2016
Direct-bandgap properties and evidence for ultraviolet lasing of hexagonal boron nitride single crystal journal May 2004
Predicting crystal structure by merging data mining with quantum mechanics journal July 2006
Crystal structure transformations in SiO2 from classical and ab initio metadynamics journal July 2006
Crystal structure prediction from first principles journal December 2008
Electronics and optoelectronics of two-dimensional transition metal dichalcogenides journal November 2012
A method for structure prediction of metal-ligand interfaces of hybrid nanoparticles journal September 2019
Learning in continuous action space for developing high dimensional potential energy models journal January 2022
Machine learning the metastable phase diagram of covalently bonded carbon journal June 2022
CEGANN: Crystal Edge Graph Attention Neural Network for multiscale classification of materials environment journal February 2023
Machine learning overcomes human bias in the discovery of self-assembling peptides journal October 2022
Quantum engineering of transistors based on 2D materials heterostructures journal March 2018
Structure prediction drives materials discovery journal April 2019
A database of low-energy atomically precise nanoclusters journal May 2023
Engineering ultrasmall water-soluble gold and silver nanoclusters for biomedical applications journal January 2014
Crystal structure prediction: reflections on present status and challenges journal January 2018
Accelerating copolymer inverse design using monte carlo tree search journal January 2020
Towards efficient discovery of green synthetic pathways with Monte Carlo tree search and reinforcement learning journal January 2020
Global minima for transition metal clusters described by Sutton–Chen potentials journal January 1998
Current and future applications of nanoclusters journal January 1999
Synthesis, structure and properties of metal nanoclusters journal January 2006
Biological applications of gold nanoparticles journal January 2008
Minima hopping: An efficient search method for the global minimum of the potential energy surface of complex molecular systems journal June 2004
A reactive potential for hydrocarbons with intermolecular interactions journal April 2000
Commentary: The Materials Project: A materials genome approach to accelerating materials innovation journal July 2013
Searching the stable segregation configuration at the grain boundary by a Monte Carlo tree search journal June 2018
Application of machine learning methods for predicting new superhard materials journal August 2020
Machine-learning of piezoelectric coefficients for wurtzite crystals journal May 2023
A Review of Thermal Transport in Low-Dimensional Materials Under External Perturbation: Effect of Strain, Substrate, and Clustering journal January 2017
Ab initio random structure searching journal January 2011
An embedded-atom potential for the Cu–Ag system journal May 2006
Structure identification methods for atomistic simulations of crystalline materials journal May 2012
Reinforcement learning in discrete action space applied to inverse defect design journal March 2021
Ab initiomolecular dynamics for liquid metals journal January 1993
Improved long-range reactive bond-order potential for carbon. I. Construction journal December 2005
Graphane: A two-dimensional hydrocarbon journal April 2007
Crystal structure prediction via particle-swarm optimization journal September 2010
On representing chemical environments journal May 2013
Extended Tersoff potential for boron nitride: Energetics and elastic properties of pristine and defective h -BN journal November 2017
Discovery of a Superhard Iron Tetraboride Superconductor journal October 2013
Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties journal April 2018
Modeling the Phase Diagram of Carbon journal April 2005
High-Pressure Phases of Silane journal July 2006
A Survey of Monte Carlo Tree Search Methods journal March 2012
The search for novel, superhard materials journal September 1999
Deep reinforcement learning for de novo drug design journal July 2018
Control of Graphene's Properties by Reversible Hydrogenation: Evidence for Graphane journal January 2009
Global Optimization of Clusters, Crystals, and Biomolecules journal August 1999
The Isomap Algorithm and Topological Stability journal January 2002
A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play journal December 2018
Reconfigurable perovskite nickelate electronics for artificial intelligence journal February 2022
Gold nanoparticles: opportunities and challenges in nanomedicine journal April 2010
Simulation of structural phase transitions by metadynamics journal May 2005
Evolutionary Crystal Structure Prediction as a Method for the Discovery of Minerals and Materials journal January 2010