DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Active causal learning for decoding chemical complexities with targeted interventions

Journal Article · · Machine Learning: Science and Technology

Abstract Predicting and enhancing inherent properties based on molecular structures is paramount to design tasks in medicine, materials science, and environmental management. Most of the current machine learning and deep learning approaches have become standard for predictions, but they face challenges when applied across different datasets due to reliance on correlations between molecular representation and target properties. These approaches typically depend on large datasets to capture the diversity within the chemical space, facilitating a more accurate approximation, interpolation, or extrapolation of the chemical behavior of molecules. In our research, we introduce an active learning approach that discerns underlying cause-effect relationships through strategic sampling with the use of a graph loss function. This method identifies the smallest subset of the dataset capable of encoding the most information representative of a much larger chemical space. The identified causal relations are then leveraged to conduct systematic interventions, optimizing the design task within a chemical space that the models have not encountered previously. While our implementation focused on the QM9 quantum-chemical dataset for a specific design task—finding molecules with a large dipole moment—our active causal learning approach, driven by intelligent sampling and interventions, holds potential for broader applications in molecular, materials design and discovery.

Sponsoring Organization:
USDOE
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
2434342
Journal Information:
Machine Learning: Science and Technology, Journal Name: Machine Learning: Science and Technology Journal Issue: 3 Vol. 5; ISSN 2632-2153
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (43)

Use of Dipole Moment as a Parameter in Drug–Receptor Interaction and Quantitative Structure–Activity Relationship Studies journal June 1982
A Deep Learning Approach to Antibiotic Discovery journal February 2020
A review on machine learning approaches and trends in drug discovery journal January 2021
De novo molecular design and generative models journal November 2021
Two optimal strategies for active learning of causal models from interventional data journal June 2014
Interpretable and Explainable Machine Learning for Materials Science and Chemistry journal June 2022
Insights into Cation Ordering of Double Perovskite Oxides from Machine Learning and Causal Relations journal August 2022
ZINC20—A Free Ultralarge-Scale Chemical Database for Ligand Discovery journal October 2020
The Relative Importance of Domain Applicability Metrics for Estimating Prediction Errors in QSAR Varies with Training Set Diversity journal June 2015
A Perspective on Explanations of Molecular Prediction Models journal March 2023
Machine Learning for Catalysis Informatics: Recent Applications and Prospects journal December 2019
Exploring Causal Physical Mechanisms via Non-Gaussian Linear Models and Deep Kernel Learning: Applications for Ferroelectric Domain Structures journal December 2021
Machine Learning in Catalysis, From Proposal to Practicing journal December 2019
Application of Combinatorial Chemistry Science on Modern Drug Discovery journal January 2008
Extended-Connectivity Fingerprints journal April 2010
Enumeration of 166 Billion Organic Small Molecules in the Chemical Universe Database GDB-17 journal November 2012
Design of efficient molecular organic light-emitting diodes by a high-throughput virtual screening and experimental approach journal August 2016
Reliable and explainable machine-learning methods for accelerated material discovery journal November 2019
Causal analysis of competing atomistic mechanisms in ferroelectric materials from high-resolution scanning transmission electron microscopy data journal August 2020
Inverse design of two-dimensional materials with invertible neural networks journal December 2021
Explainable machine learning in materials science journal September 2022
From atomically resolved imaging to generative and causal models journal August 2022
The ANI-1ccx and ANI-1x data sets, coupled-cluster and density functional theory properties for molecules journal May 2020
QM7-X, a comprehensive dataset of quantum-mechanical properties spanning the chemical space of small organic molecules journal February 2021
Drug discovery with explainable artificial intelligence journal October 2020
Guided diffusion for inverse molecular design journal October 2023
Computational design of molecules for an all-quinone redox flow battery journal January 2015
ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost journal January 2017
Scaffold-based molecular design with a graph generative model journal January 2020
Model agnostic generation of counterfactual explanations for molecules journal January 2022
QSAR without borders journal January 2020
Discovery of structure–property relations for molecules via hypothesis-driven active learning over the chemical space journal October 2023
PubChem: a public information system for analyzing bioactivities of small molecules journal June 2009
ChEMBL: a large-scale bioactivity database for drug discovery journal September 2011
Unsupervised entropy-based selection of data sets for improved model fitting conference July 2016
Machine learning–assisted molecular design and efficiency prediction for high-performance organic photovoltaic materials journal November 2019
Inverse molecular design using machine learning: Generative models for matter engineering journal July 2018
Machine learning for the prediction of molecular dipole moments obtained by density functional theory journal August 2018
Molecular representations in AI-driven drug discovery: a review and practical guide journal September 2020
Reconstructing Causal Biological Networks through Active Learning journal March 2016
Metrics for graph comparison: A practitioner’s guide journal February 2020
Accelerating Inverse Learning via Intelligent Localization with Exploratory Sampling journal June 2023
Explainable AI: A Review of Machine Learning Interpretability Methods journal December 2020