Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Bayesian Active Learning for Scanning Probe Microscopy: From Gaussian Processes to Hypothesis Learning

Journal Article · · ACS Nano

Recent progress in machine learning methods and the emerging availability of programmable interfaces for scanning probe microscopes (SPMs) have propelled automated and autonomous microscopies to the forefront of attention of the scientific community. However, enabling automated microscopy requires the development of task-specific machine learning methods, understanding the interplay between physics discovery and machine learning, and fully defined discovery workflows. This, in turn, requires balancing the physical intuition and prior knowledge of the domain scientist with rewards that define experimental goals and machine learning algorithms that can translate these to specific experimental protocols. Here, we discuss the basic principles of Bayesian active learning and illustrate its applications for SPM. We progress from the Gaussian process as a simple data-driven method and Bayesian inference for physical models as an extension of physics-based functional fits to more complex deep kernel learning methods, structured Gaussian processes, and hypothesis learning. These frameworks allow for the use of prior data, the discovery of specific functionalities as encoded in spectral data, and exploration of physical laws manifesting during the experiment. Here, the discussed framework can be universally applied to all techniques combining imaging and spectroscopy, SPM methods, nanoindentation, electron microscopy and spectroscopy, and chemical imaging methods and can be particularly impactful for destructive or irreversible measurements.

Research Organization:
Pennsylvania State Univ., University Park, PA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Basic Energy Sciences (BES). Materials Sciences & Engineering Division
Grant/Contract Number:
SC0021118
OSTI ID:
1961589
Journal Information:
ACS Nano, Journal Name: ACS Nano Journal Issue: 9 Vol. 16; ISSN 1936-0851
Publisher:
American Chemical Society (ACS)Copyright Statement
Country of Publication:
United States
Language:
English

References (89)

Local Electrochemical Functionality in Energy Storage Materials and Devices by Scanning Probe Microscopies: Status and Perspectives journal August 2010
Disentangling Ferroelectric Wall Dynamics and Identification of Pinning Mechanisms via Deep Learning journal September 2021
Surface dynamics of the layered ruthenate Ca1.9Sr0.1RuO4 journal August 2004
Fast Scanning Probe Microscopy via Machine Learning: Non‐Rectangular Scans with Compressed Sensing and Gaussian Process Optimization journal August 2020
Mapping cell wall Polysaccharides of Living Microbial Cells Using Atomic Force Microscopy journal November 1997
Three-Dimensional Electric Field Probing of Ferroelectrics on the Nanometer Scale Using Scanning Force Microscopy book January 2007
Recognition in Terra Incognita book January 2018
The Levenberg-Marquardt algorithm: Implementation and theory book January 1978
The Importance of Distributed Loading and Cantilever Angle in Piezo-Force Microscopy journal July 2004
Understanding predictive information criteria for Bayesian models journal August 2013
Current imaging tunneling spectroscopy of metallic deposits on silicon journal July 1992
Dynamic atomic force microscopy methods journal September 2002
New SPM techniques for analyzing OPV materials journal September 2010
Electrochemical SPM investigation of the solid electrolyte interphase film formed on HOPG electrodes journal June 2000
Automated tip functionalization via machine learning in scanning probe microscopy journal April 2022
Force measurements with the atomic force microscope: Technique, interpretation and applications journal October 2005
Compressive Sensing in Microscopy: a Tutorial journal July 2016
Compressed Sensing of Scanning Transmission Electron Microscopy (STEM) With Nonrectangular Scans journal December 2018
Toward Decoding the Relationship between Domain Structure and Functionality in Ferroelectrics via Hidden Latent Variables journal January 2021
Autonomous Experiments in Scanning Probe Microscopy and Spectroscopy: Choosing Where to Explore Polarization Dynamics in Ferroelectrics journal July 2021
Automated and Autonomous Experiments in Electron and Scanning Probe Microscopy journal July 2021
Probing Metastable Domain Dynamics via Automated Experimentation in Piezoresponse Force Microscopy journal September 2021
Big, Deep, and Smart Data in Scanning Probe Microscopy journal September 2016
Autonomous Scanning Probe Microscopy in Situ Tip Conditioning through Machine Learning journal May 2018
Screening Phenomena on Oxide Surfaces and Its Implications for Local Electrostatic and Transport Measurements journal April 2004
An atomic switch realized with the scanning tunnelling microscope journal August 1991
Topological surface states protected from backscattering by chiral spin texture journal August 2009
Investigation of twin-wall structure at the nanometre scale using atomic force microscopy journal June 2004
How the doors to the nanoworld were opened journal October 2006
High-veracity functional imaging in scanning probe microscopy via Graph-Bootstrapping journal June 2018
Exploring physics of ferroelectric domain walls via Bayesian analysis of atomically resolved STEM data journal December 2020
Ensemble learning-iterative training machine learning for uncertainty quantification and automated experiment in atom-resolved microscopy journal July 2021
Artificial-intelligence-driven scanning probe microscopy journal March 2020
Experimental discovery of structure–property relationships in ferroelectric materials via active learning journal April 2022
Nano-chemistry and scanning probe nanolithographies journal January 2006
An artificial intelligence atomic force microscope enabled by machine learning journal January 2018
Enabling autonomous scanning probe microscopy imaging of single molecules with deep learning journal January 2021
Kelvin probe force microscopy journal June 1991
Acoustic microscopy by atomic force microscopy journal March 1994
Magnetic dissipation force microscopy journal July 1997
Nanometer-scale electrochemical lithography on the spinel oxide LiMn2O4 journal May 2000
Contact resonances in voltage-modulated force microscopy journal July 2003
Nanoscale domains and local piezoelectric hysteresis in Pb(Zn1/3Nb2/3)O3-4.5%PbTIO3 single crystals journal November 2003
Quantitative analysis of nanoscale switching in SrBi2Ta2O9 thin filmsby piezoresponse force microscopy journal August 2004
Domain growth kinetics in lithium niobate single crystals studied by piezoresponse force microscopy journal January 2005
Nanoelectromechanics of polarization switching in piezoresponse force microscopy journal April 2005
Electronic transport imaging in a multiwire SnO2 chemical field-effect transistor device journal August 2005
Quantitative mapping of switching behavior in piezoresponse force microscopy journal July 2006
Nanoscale studies of domain wall motion in epitaxial ferroelectric thin films journal September 2006
Ferroelectric domain inversion: The role of humidity journal October 2006
Domain nucleation and hysteresis loop shape in piezoresponse force spectroscopy journal November 2006
Rapid multidimensional data acquisition in scanning probe microscopy applied to local polarization dynamics and voltage dependent contact mechanics journal September 2008
Magnetic imaging by ‘‘force microscopy’’ with 1000 Å resolution journal May 1987
Bayesian inference in band excitation scanning probe microscopy for optimal dynamic model selection in imaging journal August 2020
Scanning force microscopy and near-field scanning optical microscopy of ferroelectric and ferroelastic domain walls journal January 2000
Local Polarization Switching in Piezoresponse Force Microscopy journal August 2007
Dynamics of ferroelectric domain formation in an atomic force microscope journal May 2005
Nanoelectromechanics of piezoelectric indentation and applications to scanning probe microscopies of ferroelectric materials journal April 2005
High-resolution characterization of piezoelectric ceramics by ultrasonic scanning force microscopy techniques journal October 2002
Atom-by-atom assembly journal May 2014
Dynamic behaviour in piezoresponse force microscopy journal February 2006
The band excitation method in scanning probe microscopy for rapid mapping of energy dissipation on the nanoscale journal September 2007
Adaptive probe trajectory scanning probe microscopy for multiresolution measurements of interface geometry journal June 2009
Functional recognition imaging using artificial neural networks: applications to rapid cellular identification via broadband electromechanical response journal September 2009
Principal component and spatial correlation analysis of spectroscopic-imaging data in scanning probe microscopy journal February 2009
Data mining graphene: correlative analysis of structure and electronic degrees of freedom in graphenic monolayers with defects journal November 2016
Towards automating structural discovery in scanning transmission electron microscopy * journal February 2022
Modeling the Motion of Ferroelectric Domain Walls with the Classical Stefan Problem journal January 2020
Nanoelectromechanics of piezoresponse force microscopy journal November 2004
Interactions of an atomic force microscope tip with a reversed ferroelectric domain journal April 2005
Atomic Force Microscope journal March 1986
Domain Wall Creep in Epitaxial Ferroelectric P b ( Z r 0.2 T i 0.8 ) O 3 Thin Films journal August 2002
Atomically Precise Placement of Single Dopants in Si journal September 2003
Domain Wall Roughness in Epitaxial Ferroelectric PbZr 0.2 Ti 0.8 O 3 Thin Films journal May 2005
Deep neural networks are easily fooled: High confidence predictions for unrecognizable images conference June 2015
Taking the Human Out of the Loop: A Review of Bayesian Optimization journal January 2016
Drift compensation for automatic nanomanipulation with scanning probe microscopes journal July 2006
Kelvin probe force microscopy for characterization of semiconductor devices and processes journal March 1996
A Knowledge-Gradient Policy for Sequential Information Collection journal January 2008
Imaging and Control of Domain Structures in Ferroelectric thin Films via Scanning Force Microscopy journal August 1998
The Time Has Come: Bayesian Methods for Data Analysis in the Organizational Sciences journal September 2012
Big data and deep data in scanning and electron microscopies: deriving functionality from multidimensional data sets journal May 2015
Deep data analysis via physically constrained linear unmixing: universal framework, domain examples, and a community-wide platform journal April 2018
Using Stacking to Average Bayesian Predictive Distributions (with Discussion) journal September 2018
Spectroscopic imaging in piezoresponse force microscopy: New opportunities for studying polarization dynamics in ferroelectrics and multiferroics journal July 2012
Piezoresponse Force Microscopy: A Window into Electromechanical Behavior at the Nanoscale journal September 2009
Particle Simulations of Planetary Probe Flows Employing Automated Mesh Refinement journal May 2011
The role of convolutional neural networks in scanning probe microscopy: a review journal January 2021
Gaussian Processes for Machine Learning book January 2005