DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Autonomous reinforcement learning agent for chemical vapor deposition synthesis of quantum materials

Journal Article · · npj Computational Materials

Abstract Predictive materials synthesis is the primary bottleneck in realizing functional and quantum materials. Strategies for synthesis of promising materials are currently identified by time-consuming trial and error and there are no known predictive schemes to design synthesis parameters for materials. We use offline reinforcement learning (RL) to predict optimal synthesis schedules, i.e., a time-sequence of reaction conditions like temperatures and concentrations, for the synthesis of semiconducting monolayer MoS 2 using chemical vapor deposition. The RL agent, trained on 10,000 computational synthesis simulations, learned threshold temperatures and chemical potentials for onset of chemical reactions and predicted previously unknown synthesis schedules that produce well-sulfidized crystalline, phase-pure MoS 2 . The model can be extended to multi-task objectives such as predicting profiles for synthesis of complex structures including multi-phase heterostructures and can predict long-time behavior of reacting systems, far beyond the domain of molecular dynamics simulations, making these predictions directly relevant to experimental synthesis.

Sponsoring Organization:
USDOE
Grant/Contract Number:
NONE; SC0014607
OSTI ID:
1807979
Journal Information:
npj Computational Materials, Journal Name: npj Computational Materials Journal Issue: 1 Vol. 7; ISSN 2057-3960
Publisher:
Nature Publishing GroupCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (49)

First Principles Neural Network Potentials for Reactive Simulations of Large Molecular and Condensed Systems journal August 2017
Self-Optimizing Reactor Systems: Algorithms, On-line Analytics, Setups, and Strategies for Accelerating Continuous Flow Process Optimization journal November 2013
A scalable parallel algorithm for large-scale reactive force-field molecular dynamics simulations journal January 2008
An extended-Lagrangian scheme for charge equilibration in reactive molecular dynamics simulations journal July 2015
RXMD: A scalable reactive molecular dynamics simulator for optimized time-to-solution journal January 2020
Efficient Phase Diagram Sampling by Active Learning journal January 2020
Machine Learning Force Fields: Construction, Validation, and Outlook journal December 2016
Chemical Vapor Deposition Synthesis of MoS 2 Layers from the Direct Sulfidation of MoO 3 Surfaces Using Reactive Molecular Dynamics Simulations journal March 2018
Reactivity of Sulfur Molecules on MoO 3 (010) Surface journal December 2017
Defect Healing in Layered Materials: A Machine Learning-Assisted Characterization of MoS 2 Crystal Phases journal May 2019
Computational Synthesis of MoS 2 Layers by Reactive Molecular Dynamics Simulations: Initial Sulfidation of MoO 3 Surfaces journal July 2017
Neural Networks for the Prediction of Organic Chemistry Reactions journal October 2016
Prediction of Organic Reaction Outcomes Using Machine Learning journal April 2017
Optimizing Chemical Reactions with Deep Reinforcement Learning journal November 2017
Data-Driven Review of Thermoelectric Materials: Performance and Resource Considerations journal May 2013
Human-level control through deep reinforcement learning journal February 2015
Machine-learning-assisted materials discovery using failed experiments journal May 2016
Planning chemical syntheses with deep neural networks and symbolic AI journal March 2018
Design of efficient molecular organic light-emitting diodes by a high-throughput virtual screening and experimental approach journal August 2016
Virtual screening of inorganic materials synthesis parameters with deep learning journal December 2017
Machine learning in materials informatics: recent applications and prospects journal December 2017
New frontiers for the materials genome initiative journal April 2019
De novo exploration and self-guided learning of potential-energy surfaces journal October 2019
Attribute driven inverse materials design using deep learning Bayesian framework journal December 2019
Phase-selective synthesis of 1T′ MoS2 monolayers and heterophase bilayers journal October 2018
Inverse design in search of materials with target functionalities journal March 2018
Accelerating the discovery of materials for clean energy in the era of smart automation journal April 2018
Machine learning for molecular and materials science journal July 2018
Text-mined dataset of inorganic materials synthesis recipes journal October 2019
Optimization of Molecules via Deep Reinforcement Learning journal July 2019
Machine-learned and codified synthesis parameters of oxide materials journal September 2017
Material descriptors for predicting thermoelectric performance journal January 2015
Tuning the molecular weight distribution from atom transfer radical polymerization using deep reinforcement learning journal January 2018
Learning reduced kinetic Monte Carlo models of complex chemistry from molecular dynamics journal January 2017
Fulfilling the promise of the materials genome initiative with high-throughput experimental methodologies journal March 2017
Gaussian Approximation Potentials: The Accuracy of Quantum Mechanics, without the Electrons journal April 2010
Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties journal April 2018
Machine learning in materials design and discovery: Examples from the present and suggestions for the future journal December 2018
Reinforcement Learning for Adaptive Illumination with X-rays conference May 2020
Formation of large-area MoS 2 thin films by oxygen-catalyzed sulfurization of Mo thin films journal January 2020
Deep reinforcement learning for de novo drug design journal July 2018
Atomically thin three-dimensional membranes of van der Waals semiconductors by wafer-scale growth journal July 2019
Inverse molecular design using machine learning: Generative models for matter engineering journal July 2018
A robotic platform for flow synthesis of organic compounds informed by AI planning journal August 2019
Integrated Microreactors for Reaction Automation: New Approaches to Reaction Development journal June 2010
Efficient Discovery of Optimal N-Layered TMDC Hetero-Structures journal January 2018
A Reactive Molecular Dynamics Study of Atomistic Mechanisms During Synthesis of MoS2 Layers by Chemical Vapor Deposition journal January 2018
GTI: Learning to Generalize across Long-Horizon Tasks from Human Demonstrations conference July 2020
Deep Learning for Deep Chemistry: Optimizing the Prediction of Chemical Patterns journal November 2019