One compelling vision of the future of materials discovery and design involves the use of machine learning (ML) models to predict materials properties and then rapidly find materials tailored for specific applications. However, realizing this vision requires both providing detailed uncertainty quantification (model prediction errors and domain of applicability) and making models readily usable. At present, it is common practice in the community to assess ML model performance only in terms of prediction accuracy (e.g. mean absolute error), while neglecting detailed uncertainty quantification and robust model accessibility and usability. Here, we demonstrate a practical method for realizing both uncertainty and accessibility features with a large set of models. We develop random forest ML models for 33 materials properties spanning an array of data sources (computational and experimental) and property types (electrical, mechanical, thermodynamic, etc). All models have calibrated ensemble error bars to quantify prediction uncertainty and domain of applicability guidance enabled by kernel-density-estimate-based feature distance measures. All data and models are publicly hosted on the Garden-AI infrastructure, which provides an easy-to-use, persistent interface for model dissemination that permits models to be invoked with only a few lines of Python code. We demonstrate the power of this approach by using our models to conduct a fully ML-based materials discovery exercise to search for new stable, highly active perovskite oxide catalyst materials.
Jacobs, Ryan, Schultz, Lane E., Scourtas, Aristana, Schmidt, K. J., Price-Skelly, Owen, Engler, Will, Foster, Ian, Blaiszik, Ben, Voyles, Paul M., & Morgan, Dane (2024). Machine learning materials properties with accurate predictions, uncertainty estimates, domain guidance, and persistent online accessibility. Machine Learning: Science and Technology, 5(4). https://doi.org/10.1088/2632-2153/ad95db
Jacobs, Ryan, Schultz, Lane E., Scourtas, Aristana, et al., "Machine learning materials properties with accurate predictions, uncertainty estimates, domain guidance, and persistent online accessibility," Machine Learning: Science and Technology 5, no. 4 (2024), https://doi.org/10.1088/2632-2153/ad95db
@article{osti_2583997,
author = {Jacobs, Ryan and Schultz, Lane E. and Scourtas, Aristana and Schmidt, K. J. and Price-Skelly, Owen and Engler, Will and Foster, Ian and Blaiszik, Ben and Voyles, Paul M. and Morgan, Dane},
title = {Machine learning materials properties with accurate predictions, uncertainty estimates, domain guidance, and persistent online accessibility},
annote = {One compelling vision of the future of materials discovery and design involves the use of machine learning (ML) models to predict materials properties and then rapidly find materials tailored for specific applications. However, realizing this vision requires both providing detailed uncertainty quantification (model prediction errors and domain of applicability) and making models readily usable. At present, it is common practice in the community to assess ML model performance only in terms of prediction accuracy (e.g. mean absolute error), while neglecting detailed uncertainty quantification and robust model accessibility and usability. Here, we demonstrate a practical method for realizing both uncertainty and accessibility features with a large set of models. We develop random forest ML models for 33 materials properties spanning an array of data sources (computational and experimental) and property types (electrical, mechanical, thermodynamic, etc). All models have calibrated ensemble error bars to quantify prediction uncertainty and domain of applicability guidance enabled by kernel-density-estimate-based feature distance measures. All data and models are publicly hosted on the Garden-AI infrastructure, which provides an easy-to-use, persistent interface for model dissemination that permits models to be invoked with only a few lines of Python code. We demonstrate the power of this approach by using our models to conduct a fully ML-based materials discovery exercise to search for new stable, highly active perovskite oxide catalyst materials.},
doi = {10.1088/2632-2153/ad95db},
url = {https://www.osti.gov/biblio/2583997},
journal = {Machine Learning: Science and Technology},
issn = {ISSN 2632-2153},
number = {4},
volume = {5},
place = {United States},
publisher = {IOP Publishing},
year = {2024},
month = {12}}
HPDC '20: The 29th International Symposium on High-Performance Parallel and Distributed Computing, Proceedings of the 29th International Symposium on High-Performance Parallel and Distributed Computinghttps://doi.org/10.1145/3369583.3392683