DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: SANE: strategic autonomous non-smooth exploration for multiple optima discovery in multi-modal and non-differentiable black-box functions

Journal Article · · Digital Discovery
DOI: https://doi.org/10.1039/D4DD00299G · OSTI ID:2522847

Both computational and experimental material discovery bring forth the challenge of exploring multidimensional and multimodal parameter spaces, such as phase diagrams of Hamiltonians with multiple interactions, composition spaces of combinatorial libraries, material structure image spaces, and molecular embedding spaces. Often these systems are black-boxes and time-consuming to evaluate, which resulted in strong interest towards active learning methods such as Bayesian optimization (BO). However, these systems are often noisy which make the black box function severely multi-modal and non-differentiable, where a vanilla BO can get overly focused near a single or faux optimum, deviating from the broader goal of scientific discovery. To address these limitations, here we developed Strategic Autonomous Non-Smooth Exploration (SANE) to facilitate an intelligent Bayesian optimized navigation with a proposed cost-driven probabilistic acquisition function to find multiple global and local optimal regions, avoiding the tendency to becoming trapped in a single optimum. To distinguish between a true and false optimal region due to noisy experimental measurements, a human (domain) knowledge driven dynamic surrogate gate is integrated with SANE. We implemented the gate-SANE into pre-acquired piezoresponse spectroscopy data of a ferroelectric combinatorial library with high noise levels in specific regions, and piezoresponse force microscopy (PFM) hyperspectral data. SANE demonstrated better performance than classical BO to facilitate the exploration of multiple optimal regions and thereby prioritized learning with higher coverage of scientific values in autonomous experiments. Our work showcases the potential application of this method to real-world experiments, where such combined strategic and human intervening approaches can be critical to unlocking new discoveries in autonomous research.

Research Organization:
The Pennsylvania State University, University Park, PA (United States)
Sponsoring Organization:
Japan Science and Technology Agency (JST); USDOE; USDOE Office of Science (SC), Basic Energy Sciences (BES)
Grant/Contract Number:
AC05-00OR22725; SC0021118
OSTI ID:
2522847
Journal Information:
Digital Discovery, Journal Name: Digital Discovery Journal Issue: 3 Vol. 4; ISSN 2635-098X
Publisher:
Royal Society of Chemistry (RSC)Copyright Statement
Country of Publication:
United States
Language:
English

References (57)

Hypothesis Learning in Automated Experiment: Application to Combinatorial Materials Libraries journal April 2022
Physics Discovery in Nanoplasmonic Systems via Autonomous Experiments in Scanning Transmission Electron Microscopy journal November 2022
CAPBO: A cost‐aware parallelized Bayesian optimization method for chemical reaction optimization journal December 2023
Automated Experiments of Local Non‐Linear Behavior in Ferroelectric Materials journal October 2022
AEcroscopy: A Software–Hardware Framework Empowering Microscopy Toward Automated and Autonomous Experimentation journal April 2024
Autonomous Synthesis of Thin Film Materials with Pulsed Laser Deposition Enabled by In Situ Spectroscopy and Automation journal April 2024
Gaussian Process book January 2011
Essentials of numerical nonsmooth optimization journal February 2022
Adaptive cost-aware Bayesian optimization journal November 2021
Autonomous experimentation systems for materials development: A community perspective journal September 2021
COMBO: An efficient Bayesian optimization library for materials science journal June 2016
Bayesian optimization on graph-structured search spaces: Optimizing deep multimodal fusion architectures journal July 2018
Explainability and human intervention in autonomous scanning probe microscopy journal November 2023
Toward autonomous laboratories: Convergence of artificial intelligence and experimental automation journal February 2023
Bayesian Optimization book January 2023
Gaussian Process Regression for Materials and Molecules journal August 2021
Automated and Autonomous Experiments in Electron and Scanning Probe Microscopy journal July 2021
Bayesian Conavigation: Dynamic Designing of the Material Digital Twins via Active Learning journal August 2024
Evolution of Ferroelectric Properties in SmxBi1–xFeO3 via Automated Piezoresponse Force Microscopy across combinatorial spread libraries journal September 2024
Efficient Global Optimization of Expensive Black-Box Functions journal January 1998
A Taxonomy of Global Optimization Methods Based on Response Surfaces journal December 2001
On-the-fly closed-loop materials discovery via Bayesian active learning journal November 2020
Autonomous optimization of non-aqueous Li-ion battery electrolytes via robotic experimentation and machine learning coupling journal September 2022
Learning the right channel in multimodal imaging: automated experiment in piezoresponse force microscopy journal March 2023
A dynamic Bayesian optimized active recommender system for curiosity-driven partially Human-in-the-loop automated experiments journal February 2024
Active oversight and quality control in standard Bayesian optimization for autonomous experiments journal January 2025
A mobile robotic chemist journal July 2020
Human–machine collaboration for improving semiconductor process development journal March 2023
Efficient Closed-loop Maximization of Carbon Nanotube Growth Rate using Bayesian Optimization journal June 2020
Autonomous materials discovery driven by Gaussian process regression with inhomogeneous measurement noise and anisotropic kernels journal October 2020
Experimental discovery of structure–property relationships in ferroelectric materials via active learning journal April 2022
AtomAI framework for deep learning analysis of image and spectroscopy data in electron and scanning probe microscopy journal December 2022
The rise of self-driving labs in chemical and materials sciences journal January 2023
Constrained Bayesian optimization for automatic chemical design using variational autoencoders journal January 2020
Physics-driven discovery and bandgap engineering of hybrid perovskites journal January 2024
Co-orchestration of multiple instruments to uncover structure–property relationships in combinatorial libraries journal January 2024
Scientific exploration with expert knowledge (SEEK) in autonomous scanning probe microscopy with active learning journal January 2025
Combinatorial discovery of a lead-free morphotropic phase boundary in a thin-film piezoelectric perovskite journal May 2008
Guided search for desired functional responses via Bayesian optimization of generative model: Hysteresis loop shape engineering in ferroelectrics journal July 2020
Multi-objective Bayesian optimization of ferroelectric materials with interfacial control for memory and energy storage applications journal November 2021
Autonomous convergence of STM control parameters using Bayesian optimization journal March 2024
Unraveling the impact of initial choices and in-loop interventions on learning dynamics in autonomous scanning probe microscopy journal April 2024
Human-in-the-Loop: The Future of Machine Learning in Automated Electron Microscopy journal February 2024
Effect of Surface Ionic Screening on Polarization Reversal and Phase Diagrams in Thin Antiferroelectric Films for Information and Energy Storage journal October 2021
Chemical control of polarization in thin strained films of a multiaxial ferroelectric: Phase diagrams and polarization rotation journal March 2022
A statistical method for global optimization conference January 1992
Taking the Human Out of the Loop: A Review of Bayesian Optimization journal January 2016
A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise journal March 1964
An Approach to Bayesian Optimization for Design Feasibility Check on Discontinuous Black-Box Functions journal February 2021
Multi-Model Bayesian Optimization for Simulation-Based Design journal May 2021
Toward Accelerating Discovery via Physics-Driven and Interactive Multifidelity Bayesian Optimization journal November 2024
A Multi-Objective Bayesian Optimized Human Assessed Multi-Target Generated Spectral Recommender System for Rapid Pareto Discoveries of Material Properties conference August 2023
Non-smooth Bayesian optimization in tuning scientific applications journal September 2024
Self-Driving Laboratories for Chemistry and Materials Science preprint June 2024
A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning preprint January 2010
Cost-aware Bayesian Optimization preprint January 2020
Active learning in open experimental environments: selecting the right information channel(s) based on predictability in deep kernel learning preprint January 2022