DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Evaluating Stage Motion for Automated Electron Microscopy

Journal Article · · Microscopy and Microanalysis

Abstract Precise control is an essential and elusive quality of emerging self-driving transmission electron microscopes (TEMs). It is widely understood these instruments must be capable of performing rapid, high-volume, and arbitrary movements for practical self-driving operation. However, stage movements are difficult to automate at scale, owing to mechanical instability, hysteresis, and thermal drift. Such difficulties pose major barriers to artificial intelligence-directed microscope designs that require repeatable, precise movements. To guide design of emerging instruments, it is necessary to understand the behavior of existing mechanisms to identify rate limiting steps for full autonomy. Here, we describe a general framework to evaluate stage motion in any TEM. We define metrics to evaluate stage degrees of freedom, propose solutions to improve performance, and comment on fundamental limits to automated experimentation using present hardware.

Sponsoring Organization:
USDOE
OSTI ID:
2202308
Journal Information:
Microscopy and Microanalysis, Journal Name: Microscopy and Microanalysis Journal Issue: 6 Vol. 29; ISSN 1431-9276
Publisher:
Oxford University PressCopyright Statement
Country of Publication:
United States
Language:
English

References (41)

Artificial Intelligence to Power the Future of Materials Science and Engineering journal March 2020
Leginon: An Automated System for Acquisition of Images from Vitreous Ice Specimens journal October 2000
Applications of machine learning and artificial intelligence for Covid-19 (SARS-CoV-2) pandemic: A review journal October 2020
SerialEM: A Program for Automated Tilt Series Acquisition on Tecnai Microscopes Using Prediction of Specimen Position journal July 2003
Machine Learning Pipeline for Segmentation and Defect Identification from High-Resolution Transmission Electron Microscopy Data journal May 2021
Automating Electron Microscopy through Machine Learning and USETEM journal July 2021
An Automated Scanning Transmission Electron Microscope Guided by Sparse Data Analytics journal June 2022
Towards Augmented Microscopy with Reinforcement Learning-Enhanced Workflows journal December 2022
Automated and Autonomous Experiments in Electron and Scanning Probe Microscopy journal July 2021
Bayesian Active Learning for Scanning Probe Microscopy: From Gaussian Processes to Hypothesis Learning journal September 2022
Probing Electron Beam Induced Transformations on a Single-Defect Level via Automated Scanning Transmission Electron Microscopy journal October 2022
Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations journal October 2016
A petascale automated imaging pipeline for mapping neuronal circuits with high-throughput transmission electron microscopy journal October 2020
Recent advances and applications of machine learning in solid-state materials science journal August 2019
Rapid and flexible segmentation of electron microscopy data using few-shot machine learning journal November 2021
Bridging microscopy with molecular dynamics and quantum simulations: an atomAI based pipeline journal April 2022
Microstructure segmentation with deep learning encoders pre-trained on a large microscopy dataset journal September 2022
Forecasting of in situ electron energy loss spectroscopy journal December 2022
Towards data-driven next-generation transmission electron microscopy journal October 2020
Emerging materials intelligence ecosystems propelled by machine learning journal November 2020
Machine learning for molecular and materials science journal July 2018
Software tools for automated transmission electron microscopy journal May 2019
SciPy 1.0: fundamental algorithms for scientific computing in Python journal February 2020
MIST: Accurate and Scalable Microscopy Image Stitching Tool with Stage Modeling and Error Minimization journal July 2017
Experimental discovery of structure–property relationships in ferroelectric materials via active learning journal April 2022
AtomAI framework for deep learning analysis of image and spectroscopy data in electron and scanning probe microscopy journal December 2022
The FAIR Guiding Principles for scientific data management and stewardship journal March 2016
A magnification-continuous calibration method for SEM-based nanorobotic manipulation systems journal May 2019
Automated Mechanical Characterization of 2-D Materials using SEM based Visual Servoing journal October 2013
Scanning Electron Microscope Calibration Using a Multi-Image Non-Linear Minimization Process journal April 2015
A landmark-based 3D calibration strategy for SPM journal January 2007
Applications of deep learning in electron microscopy journal February 2022
Application of machine learning techniques to electron microscopic/spectroscopic image data analysis journal November 2019
Learning motifs and their hierarchies in atomic resolution microscopy journal April 2022
Identifying local structural states in atomic imaging by computer vision journal November 2016
Automated Transmission-Mode Scanning Electron Microscopy (tSEM) for Large Volume Analysis at Nanoscale Resolution journal March 2013
Materials science in the artificial intelligence age: high-throughput library generation, machine learning, and a pathway from correlations to the underpinning physics journal July 2019
Frontiers of in situ electron microscopy journal January 2015
Deep learning for electron and scanning probe microscopy: From materials design to atomic fabrication journal September 2022
Applications of Machine Learning Predictive Models in the Chronic Disease Diagnosis journal March 2020
The measurement and uncertainty of a calibration standard for the scanning electron microscope journal March 1994