Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

High‐speed 4‐dimensional scanning transmission electron microscopy using compressive sensing techniques

Journal Article · · Journal of Microscopy
DOI:https://doi.org/10.1111/jmi.13315· OSTI ID:2346227
 [1];  [2];  [3];  [1];  [4];  [5];  [6];  [1]
  1. Department of Mechanical, Materials and Aerospace Engineering University of Liverpool Liverpool UK, SenseAI Innovations Ltd. University of Liverpool Liverpool UK
  2. Department of Mechanical, Materials and Aerospace Engineering University of Liverpool Liverpool UK, Correlated Imaging Group Rosalind Franklin Institute, Harwell Science and Innovation Campus Didcot UK
  3. SenseAI Innovations Ltd. University of Liverpool Liverpool UK, Distributed Algorithms Centre for Doctoral Training University of Liverpool Liverpool UK
  4. Chemical Science Division, Centre for Nanophase Materials Sciences Oak Ridge National Laboratory Oak Ridge Tennessee USA
  5. School of Physics and Astronomy University of Glasgow Glasgow UK
  6. Correlated Imaging Group Rosalind Franklin Institute, Harwell Science and Innovation Campus Didcot UK, Department of Materials University of Oxford Oxford UK
Abstract

Here we show that compressive sensing allows 4‐dimensional (4‐D) STEM data to be obtained and accurately reconstructed with both high‐speed and reduced electron fluence. The methodology needed to achieve these results compared to conventional 4‐D approaches requires only that a random subset of probe locations is acquired from the typical regular scanning grid, which immediately generates both higher speed and the lower fluence experimentally. We also consider downsampling of the detector, showing that oversampling is inherent within convergent beam electron diffraction (CBED) patterns and that detector downsampling does not reduce precision but allows faster experimental data acquisition. Analysis of an experimental atomic resolution yttrium silicide dataset shows that it is possible to recover over 25 dB peak signal‐to‐noise ratio in the recovered phase using 0.3% of the total data.

Lay abstract : Four‐dimensional scanning transmission electron microscopy (4‐D STEM) is a powerful technique for characterizing complex nanoscale structures. In this method, a convergent beam electron diffraction pattern (CBED) is acquired at each probe location during the scan of the sample. This means that a 2‐dimensional signal is acquired at each 2‐D probe location, equating to a 4‐D dataset.

Despite the recent development of fast direct electron detectors, some capable of 100kHz frame rates, the limiting factor for 4‐D STEM is acquisition times in the majority of cases, where cameras will typically operate on the order of 2kHz. This means that a raster scan containing 256^2 probe locations can take on the order of 30s, approximately 100‐1000 times longer than a conventional STEM imaging technique using monolithic radial detectors. As a result, 4‐D STEM acquisitions can be subject to adverse effects such as drift, beam damage, and sample contamination.

Recent advances in computational imaging techniques for STEM have allowed for faster acquisition speeds by way of acquiring only a random subset of probe locations from the field of view. By doing this, the acquisition time is significantly reduced, in some cases by a factor of 10‐100 times. The acquired data is then processed to fill‐in or inpaint the missing data, taking advantage of the inherently low‐complex signals which can be linearly combined to recover the information.

In this work, similar methods are demonstrated for the acquisition of 4‐D STEM data, where only a random subset of CBED patterns are acquired over the raster scan. We simulate the compressive sensing acquisition method for 4‐D STEM and present our findings for a variety of analysis techniques such as ptychography and differential phase contrast. Our results show that acquisition times can be significantly reduced on the order of 100‐300 times, therefore improving existing frame rates, as well as further reducing the electron fluence beyond just using a faster camera.

Sponsoring Organization:
USDOE
OSTI ID:
2346227
Journal Information:
Journal of Microscopy, Journal Name: Journal of Microscopy Journal Issue: 3 Vol. 295; ISSN 0022-2720
Publisher:
Wiley-BlackwellCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (59)

Dynamische Theorie der Kristallstrukturanalyse durch Elektronenbeugung im inhomogenen Primärstrahlwellenfeld journal November 1970
Compressed Sensing and Electron Microscopy book January 2012
Trace structure analysis, ptychography, phase tomography journal January 1982
Sub-ångström transmission microscopy: A fourier transform algorithm for microdiffraction plane intensity information journal November 1989
Experimental study of annular bright field (ABF) imaging using aberration-corrected scanning transmission electron microscopy (STEM) journal March 2012
Direct single electron detection with a CMOS detector for electron microscopy
  • Faruqi, A. R.; Henderson, R.; Pryddetch, M.
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 546, Issue 1-2 https://doi.org/10.1016/j.nima.2005.03.023
journal July 2005
Direct imaging detectors for electron microscopy journal January 2018
Electronic detectors for electron microscopy journal October 2007
An improved ptychographical phase retrieval algorithm for diffractive imaging journal September 2009
An annealing algorithm to correct positioning errors in ptychography journal September 2012
Measurement of atomic electric fields and charge densities from average momentum transfers using scanning transmission electron microscopy journal July 2017
Electron ptychographic phase imaging of light elements in crystalline materials using Wigner distribution deconvolution journal September 2017
High dose efficiency atomic resolution imaging via electron ptychography journal January 2019
Contrast transfer and noise considerations in focused-probe electron ptychography journal February 2021
Dose measurement in the TEM and STEM journal October 2021
Sub-Sampled Imaging for STEM: Maximising Image Speed, Resolution and Precision Through Reconstruction Parameter Refinement journal March 2022
SIM-STEM Lab: Incorporating Compressed Sensing Theory for Fast STEM Simulation journal December 2022
Framework of compressive sensing and data compression for 4D-STEM journal May 2024
Lorentz Stem: A Digital Approach to an old journal August 2001
Quantitative Measurements of Magnetic Vortices using Position Resolved Diffraction in Lorentz Stem journal August 2002
A Comparison of Phase-retrieval Algorithms for Focused-probe Electron Ptychography journal July 2017
Four-Dimensional Scanning Transmission Electron Microscopy (4D-STEM): From Scanning Nanodiffraction to Ptychography and Beyond journal May 2019
The 4D Camera: Very High Speed Electron Counting for 4D-STEM journal August 2019
How many detector pixels do we need for super-resolution ptychography? journal July 2021
Very-High Dynamic Range, 10,000 Frames/Second Pixel Array Detector for Electron Microscopy journal March 2022
Compressed STEM Simulations journal August 2022
Radiation Damage and Nanofabrication in TEM and STEM journal May 2021
4D-STEM of Beam-Sensitive Materials journal May 2021
Low-Dose Aberration-Free Imaging of Li-Rich Cathode Materials at Various States of Charge Using Electron Ptychography journal September 2018
4D-STEM Ptychography for Electron-Beam-Sensitive Materials journal November 2022
Resolution beyond the 'information limit' in transmission electron microscopy journal April 1995
Simultaneous atomic-resolution electron ptychography and Z-contrast imaging of light and heavy elements in complex nanostructures journal August 2016
Differential phase-contrast microscopy at atomic resolution journal June 2012
Minimising damage in high resolution scanning transmission electron microscope images of nanoscale structures and processes journal January 2020
A phase retrieval algorithm for shifting illumination journal November 2004
Subsampled STEM-ptychography journal July 2018
Controlling the spatio-temporal dose distribution during STEM imaging by subsampled acquisition: In-situ observations of kinetic processes in liquids journal August 2019
Phase reconstruction using fast binary 4D STEM data journal March 2020
Detectors—The ongoing revolution in scanning transmission electron microscopy and why this important to material characterization journal November 2020
4D STEM: High efficiency phase contrast imaging using a fast pixelated detector journal October 2015
A pnCCD-based, fast direct single electron imaging camera for TEM and STEM journal April 2016
The potential for Bayesian compressive sensing to significantly reduce electron dose in high-resolution STEM images journal October 2013
The theory of super-resolution electron microscopy via Wigner-distribution deconvolution
  • Rodenburg, J. M.; Bates, R. H. T.
  • Philosophical Transactions of the Royal Society of London. Series A: Physical and Engineering Sciences, Vol. 339, Issue 1655, p. 521-553 https://doi.org/10.1098/rsta.1992.0050
journal June 1992
Deterministic electron ptychography at atomic resolution journal February 2014
Beugung in inhomogenen Primärstrahlenwellenfeld. II. Lichtoptische Analogieversuche zur Phasenmessung von Gitterinterferenzen journal July 1969
Beugung im inhomogenen Primärstrahlwellenfeld. III. Amplituden- und Phasenbestimmung bei unperiodischen Objekten journal July 1969
Compressive Scanning Transmission Electron Microscopy conference May 2022
A Targeted Sampling Strategy for Compressive Cryo Focused Ion Beam Scanning Electron Microscopy conference June 2023
Compressed Sensing Reconstruction of Hyperspectral Images Based on Spectral Unmixing journal April 2018
Image Quality Assessment: From Error Visibility to Structural Similarity journal April 2004
Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information journal February 2006
Compressed sensing journal April 2006
Towards real‐time STEM simulations through targeted subsampling strategies journal February 2023
Direct visualization of anionic electrons in an electride reveals inhomogeneities journal April 2021
Electron ptychography achieves atomic-resolution limits set by lattice vibrations journal May 2021
Formation and Property of Yttrium and Yttrium Silicide Films as Low Schottcky Barrier material for n-Type Silicon journal April 2008
Nonparametric factor analysis with beta process priors conference January 2009
Phase retrieval by iterated projections journal January 2003
Ptychographic transmission microscopy in three dimensions using a multi-slice approach journal January 2012

Similar Records

Dynamic scan control in STEM: spiral scans
Journal Article · Sun Jun 12 20:00:00 EDT 2016 · Advanced Structural and Chemical Imaging · OSTI ID:1256773

Compressive Classification for TEM-EELS
Journal Article · Mon Jul 03 00:00:00 EDT 2017 · Microscopy and Microanalysis · OSTI ID:1512450

Related Subjects