DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Active learning enables generation of molecules that advance the known Pareto front

Journal Article · · npj Computational Materials

Although generative models hold promise for discovering molecules with optimized desired properties, they often fail to suggest synthesizable molecules that improve upon the properties of the structures represented in the training distribution. We find that this limitation arises not only from the molecule generation process itself, but also from the poor generalization capabilities of molecular property predictors. We address this challenge by creating a closed-loop molecule generation pipeline with iterative retraining on new quantum chemical simulation data. Compared against static, single-pass generative modeling approaches, only our closed-loop iterative workflow generates molecules with properties extending beyond the training distribution (up to 0.44 standard deviations beyond the original range) and achieves a 79% improvement in out-of-distribution molecule classification accuracy. Furthermore, by conditioning molecular generation on thermodynamic stability data obtained during the iterative loop, the proportion of stable and hence potentially synthesizable molecules generated is 3.5x higher than the next-best model.

Research Organization:
Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
AC52-07NA27344
OSTI ID:
3024470
Report Number(s):
LLNL-JRNL-2001596
Journal Information:
npj Computational Materials, Journal Name: npj Computational Materials Journal Issue: 1 Vol. 12; ISSN 2057-3960
Publisher:
Nature Publishing GroupCopyright Statement
Country of Publication:
United States
Language:
English

References (52)

The art and practice of structure-based drug design: A molecular modeling perspective journal January 1996
Inverse Design of Singlet‐Fission Materials with Uncertainty‐Controlled Genetic Optimization journal November 2024
Neural-Symbolic Machine Learning for Retrosynthesis and Reaction Prediction journal February 2017
Molecular surface electrostatic potentials in relation to noncovalent interactions in biological systems journal January 2001
Generative models for molecular discovery: Recent advances and challenges journal March 2022
AiiDA: automated interactive infrastructure and database for computational science journal January 2016
NWChem: A comprehensive and scalable open-source solution for large scale molecular simulations journal September 2010
Machine Learning guided early drug discovery of small molecules journal August 2022
The Synthesizability of Molecules Proposed by Generative Models journal April 2020
Data Augmentation and Pretraining for Template-Based Retrosynthetic Prediction in Computer-Aided Synthesis Planning journal June 2020
REINVENT 2.0: An AI Tool for De Novo Drug Design journal October 2020
Predicting Energetics Materials’ Crystalline Density from Chemical Structure by Machine Learning journal April 2021
Chemprop: A Machine Learning Package for Chemical Property Prediction journal December 2023
SCScore: Synthetic Complexity Learned from a Reaction Corpus journal January 2018
Analyzing Learned Molecular Representations for Property Prediction journal July 2019
Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules journal January 2018
Improved Prediction of Heats of Formation of Energetic Materials Using Quantum Mechanical Calculations journal January 2006
Deep learning for development of organic optoelectronic devices: efficient prescreening of hosts and emitters in deep-blue fluorescent OLEDs journal July 2022
Structure-based out-of-distribution (OOD) materials property prediction: a benchmark study journal July 2024
Artificial intelligence–enabled virtual screening of ultra-large chemical libraries with deep docking journal February 2022
AiiDA 1.0, a scalable computational infrastructure for automated reproducible workflows and data provenance journal September 2020
Regression Transformer enables concurrent sequence regression and generation for molecular language modelling journal April 2023
Quantum chemistry structures and properties of 134 kilo molecules journal August 2014
Lead candidates for high-performance organic photovoltaics from high-throughput quantum chemistry – the Harvard Clean Energy Project journal January 2014
MoleculeNet: a benchmark for molecular machine learning journal January 2018
Large-scale comparison of machine learning methods for drug target prediction on ChEMBL journal January 2018
A graph-based genetic algorithm and generative model/Monte Carlo tree search for the exploration of chemical space journal January 2019
Constrained Bayesian optimization for automatic chemical design using variational autoencoders journal January 2020
Retrosynthetic accessibility score (RAscore) – rapid machine learned synthesizability classification from AI driven retrosynthetic planning journal January 2021
Beyond generative models: superfast traversal, optimization, novelty, exploration and discovery (STONED) algorithm for molecules using SELFIES journal January 2021
Parallel tempered genetic algorithm guided by deep neural networks for inverse molecular design journal January 2022
By how much can closed-loop frameworks accelerate computational materials discovery? journal January 2023
Realistic material property prediction using domain adaptation based machine learning journal January 2024
Generative organic electronic molecular design informed by quantum chemistry journal January 2023
Sample efficient reinforcement learning with active learning for molecular design journal January 2024
Inverse design of copolymers including stoichiometry and chain architecture journal January 2025
Directly optimizing for synthesizability in generative molecular design using retrosynthesis models journal January 2025
Method for measurement of the density of thin films of small organic molecules journal March 2007
Self-referencing embedded strings (SELFIES): A 100% robust molecular string representation journal November 2020
Prediction of metabolic reactions based on atomic and molecular properties of small-molecule compounds journal April 2011
The Cambridge Structural Database
  • Groom, Colin R.; Bruno, Ian J.; Lightfoot, Matthew P.
  • Acta Crystallographica Section B Structural Science, Crystal Engineering and Materials, Vol. 72, Issue 2, p. 171-179 https://doi.org/10.1107/S2052520616003954
journal April 2016
Inverse molecular design using machine learning: Generative models for matter engineering journal July 2018
Estimation of synthetic accessibility score of drug-like molecules based on molecular complexity and fragment contributions journal June 2009
Molecular de-novo design through deep reinforcement learning journal September 2017
Integrating synthetic accessibility with AI-based generative drug design journal September 2023
Computational Chemical Synthesis Analysis and Pathway Design journal June 2018
Virtual Screening Algorithms in Drug Discovery: A Review Focused on Machine and Deep Learning Methods journal May 2023
Junction Tree Variational Autoencoder for Molecular Graph Generation preprint January 2018
Geometric Latent Diffusion Models for 3D Molecule Generation preprint January 2023
Generative Active Learning for the Search of Small-molecule Protein Binders preprint January 2024
Sample Efficiency Matters: A Benchmark for Practical Molecular Optimization conference January 2022
Tartarus: A Benchmarking Platform for Realistic And Practical Inverse Molecular Design conference January 2023

Similar Records

A Pareto Algorithm for Efficient De Novo Design of Multi-functional Molecules
Journal Article · Thu Jul 21 00:00:00 UTC 2016 · Molecular Informatics · OSTI ID:1533191

PNNL-CompBio/3D_Scaffold
Software · Tue Apr 15 00:00:00 UTC 2025 · OSTI ID:code-154053

A Perturbative Solution for Nonlinear Stratified Upwelling over a Frictional Slope
Journal Article · Sun Oct 01 04:00:00 UTC 2023 · Journal of Physical Oceanography · OSTI ID:2580152

Related Subjects