Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Benchmarking the Performance of Uncertainty Quantification Methods for Neural Network-Based Interatomic Potentials

Journal Article · · Journal of Cheminformatics
 [1];  [1];  [2];  [2]
  1. National Laboratory of the Rockies, Golden, CO (United States)
  2. Lawrence Livermore National Laboratory
Machine-learned interatomic potentials (ML-IAPs) continue to gain popularity as accurate, computationally efficient replacements for traditional, physics-based interatomic potentials and expensive ab initio methods. Uncertainty quantification (UQ) of ML-IAPs is a growing area of research as UQ is critical in many applications of IAPs, such as developing curated datasets, active learning-based data augmentation, self-improving models, and estimating the uncertainty of molecular dynamics simulations. In this paper, we construct and benchmark a series of different neural network potentials (NNPs) with varying network architectures to determine the performance of these models with respect to both the mean and uncertainty calibration error. Each NNP method is specifically designed to predict either epistemic or aleatoric uncertainty with particular focus on the differences in behavior between the epistemic and aleatoric uncertainty estimates. We benchmark these methods using multiple datasets common in the ML-IAP literature. The results show that the aleatoric uncertainty from single-shot model architectures is a competitive alternative to ensemble-based epistemic uncertainty predictions in regions of sufficient data-density. However, in regions where the representative data is sparse, aleatoric uncertainty models tend to overpredict and epistemic methods tend to underpredict the actual model error. We conclude that the type of UQ is crucial when discussing performance of probabilistic model results as different methods have different performance characteristics depending on the regime in which they are evaluated. Therefore, the type of UQ method should be carefully evaluated against both the data characteristics and requirements for the intended application.
Research Organization:
National Laboratory of the Rockies (NLR), Golden, CO (United States)
Sponsoring Organization:
USDOE Lawrence Livermore National Laboratory (LLNL), Laboratory Directed Research and Development (LDRD) Program
DOE Contract Number:
AC36-08GO28308;
OSTI ID:
3030039
Report Number(s):
NLR/JA-2C00-96528
Journal Information:
Journal of Cheminformatics, Journal Name: Journal of Cheminformatics
Country of Publication:
United States
Language:
English

Similar Records

Uncertainty quantification for molecular property predictions with graph neural architecture search
Journal Article · Mon Jun 24 20:00:00 EDT 2024 · Digital Discovery · OSTI ID:2438089

Uncertainty quantification of a deep learning fuel property prediction model
Journal Article · Sat Sep 23 20:00:00 EDT 2023 · Applications in Energy and Combustion Science · OSTI ID:2536669