DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: AEcroscopy: A Software–Hardware Framework Empowering Microscopy Toward Automated and Autonomous Experimentation

Journal Article · · Small Methods
ORCiD logo [1];  [1];  [1];  [2];  [3];  [1];  [1]
  1. Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Center for Nanophase Materials Sciences (CNMS)
  2. Univ. of Tennessee, Knoxville, TN (United States)
  3. National Cheng Kung University (Taiwan)

Microscopy has been pivotal in improving the understanding of structure-function relationships at the nanoscale and is by now ubiquitous in most characterization labs. However, traditional microscopy operations are still limited largely by a human-centric click-and-go paradigm utilizing vendor-provided software, which limits the scope, utility, efficiency, effectiveness, and at times reproducibility of microscopy experiments. Here, in this work, a coupled software–hardware platform is developed that consists of a software package termed AEcroscopy (short for Automated Experiments in Microscopy), along with a field-programmable-gate-array device with LabView-built customized acquisition scripts, which overcome these limitations and provide the necessary abstractions toward full automation of microscopy platforms. The platform works across multiple vendor devices on scanning probe microscopes and electron microscopes. It enables customized scan trajectories, processing functions that can be triggered locally or remotely on processing servers, user-defined excitation waveforms, standardization of data models, and completely seamless operation through simple Python commands to enable a plethora of microscopy experiments to be performed in a reproducible, automated manner. This platform can be readily coupled with existing machine-learning libraries and simulations, to provide automated decision-making and active theory-experiment optimization to turn microscopes from characterization tools to instruments capable of autonomous model refinement and physics discovery.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities (SUF)
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
2438949
Journal Information:
Small Methods, Journal Name: Small Methods Journal Issue: 10 Vol. 8; ISSN 2366-9608
Publisher:
WileyCopyright Statement
Country of Publication:
United States
Language:
English

References (34)

Nanoscale Origins of Nonlinear Behavior in Ferroic Thin Films journal August 2012
Beyond Ternary OPV: High‐Throughput Experimentation and Self‐Driving Laboratories Optimize Multicomponent Systems journal April 2020
Artificial Chemist: An Autonomous Quantum Dot Synthesis Bot journal June 2020
Hypothesis Learning in Automated Experiment: Application to Combinatorial Materials Libraries journal April 2022
A Processing and Analytics System for Microscopy Data Workflows: The Pycroscopy Ecosystem of Packages journal September 2023
Exploring Physics of Ferroelectric Domain Walls in Real Time: Deep Learning Enabled Scanning Probe Microscopy journal September 2022
Automated Experiments of Local Non‐Linear Behavior in Ferroelectric Materials journal October 2022
Autonomous chemical science and engineering enabled by self-driving laboratories journal June 2022
Autonomous experimentation systems for materials development: A community perspective journal September 2021
Sustainable materials acceleration platform reveals stable and efficient wide-bandgap metal halide perovskite alloys journal September 2023
Image reconstruction for sub-sampled atomic force microscopy images using deep neural networks journal March 2020
Autonomous Chemical Experiments: Challenges and Perspectives on Establishing a Self-Driving Lab journal August 2022
Exploring the Relationship of Microstructure and Conductivity in Metal Halide Perovskites via Active Learning-Driven Automated Scanning Probe Microscopy journal March 2023
Autonomous Experiments in Scanning Probe Microscopy and Spectroscopy: Choosing Where to Explore Polarization Dynamics in Ferroelectrics journal July 2021
Bayesian Active Learning for Scanning Probe Microscopy: From Gaussian Processes to Hypothesis Learning journal September 2022
Automating drug discovery journal December 2017
High-speed mapping of surface charge dynamics using sparse scanning Kelvin probe force microscopy journal November 2023
Learning the right channel in multimodal imaging: automated experiment in piezoresponse force microscopy journal March 2023
A dynamic Bayesian optimized active recommender system for curiosity-driven partially Human-in-the-loop automated experiments journal February 2024
Pycro-Manager: open-source software for customized and reproducible microscope control journal March 2021
Towards automation of the polyol process for the synthesis of silver nanoparticles journal April 2022
Experimental discovery of structure–property relationships in ferroelectric materials via active learning journal April 2022
The rise of self-driving labs in chemical and materials sciences journal January 2023
A robotic platform for the synthesis of colloidal nanocrystals journal March 2023
Precision controlled atomic resolution scanning transmission electron microscopy using spiral scan pathways journal March 2017
High-speed Lissajous-scan atomic force microscopy: Scan pattern planning and control design issues journal June 2012
Designing workflows for materials characterization journal March 2024
Collective dynamics underpins Rayleigh behavior in disordered polycrystalline ferroelectrics journal April 2010
Automated piezoresponse force microscopy domain tracking during fast thermally stimulated phase transition in CuInP2S6 * journal May 2023
Synergizing human expertise and AI efficiency with language model for microscopy operation and automated experiment design * journal June 2024
An artificial intelligence enabled chemical synthesis robot for exploration and optimization of nanomaterials journal October 2022
Band Excitation in Scanning Probe Microscopy: Recognition and Functional Imaging journal April 2014
Dynamic scan control in STEM: spiral scans journal June 2016
Automation in the Life Science Research Laboratory journal November 2020