DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Manifold learning of four-dimensional scanning transmission electron microscopy

Abstract

Four-dimensional scanning transmission electron microscopy (4D-STEM) of local atomic diffraction patterns is emerging as a powerful technique for probing intricate details of atomic structure and atomic electric fields. However, efficient processing and interpretation of large volumes of data remain challenging, especially for two-dimensional or light materials because the diffraction signal recorded on the pixelated arrays is weak. Here we employ data-driven manifold leaning approaches for straightforward visualization and exploration analysis of 4D-STEM datasets, distilling real-space neighboring effects on atomically resolved deflection patterns from single-layer graphene, with single dopant atoms, as recorded on a pixelated detector. These extracted patterns relate to both individual atom sites and sublattice structures, effectively discriminating single dopant anomalies via multi-mode views. We believe manifold learning analysis will accelerate physics discoveries coupled between data-rich imaging mechanisms and materials such as ferroelectric, topological spin, and van der Waals heterostructures.

Authors:
 [1];  [1];  [1];  [1]; ORCiD logo [2];  [3];  [1];  [1]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Center for Nanophase Materials Science (CNMS); Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Inst. for Functional Imaging of Materials
  2. Tutte Inst. for Mathematics and Computing, Ottawa (Canada)
  3. Tutte Inst. for Mathematics and Computing, Ottawa (Canada
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Basic Energy Sciences (BES)
OSTI Identifier:
1491307
Grant/Contract Number:  
AC05-00OR22725
Resource Type:
Accepted Manuscript
Journal Name:
npj Computational Materials
Additional Journal Information:
Journal Volume: 5; Journal Issue: 1; Journal ID: ISSN 2057-3960
Publisher:
Nature Publishing Group
Country of Publication:
United States
Language:
English
Subject:
47 OTHER INSTRUMENTATION

Citation Formats

Li, Xin, Dyck, Ondrej E., Oxley, Mark P., Lupini, Andrew R., McInnes, Leland, Healy, John, Jesse, Stephen, and Kalinin, Sergei V. Manifold learning of four-dimensional scanning transmission electron microscopy. United States: N. p., 2019. Web. doi:10.1038/s41524-018-0139-y.
Li, Xin, Dyck, Ondrej E., Oxley, Mark P., Lupini, Andrew R., McInnes, Leland, Healy, John, Jesse, Stephen, & Kalinin, Sergei V. Manifold learning of four-dimensional scanning transmission electron microscopy. United States. https://doi.org/10.1038/s41524-018-0139-y
Li, Xin, Dyck, Ondrej E., Oxley, Mark P., Lupini, Andrew R., McInnes, Leland, Healy, John, Jesse, Stephen, and Kalinin, Sergei V. Mon . "Manifold learning of four-dimensional scanning transmission electron microscopy". United States. https://doi.org/10.1038/s41524-018-0139-y. https://www.osti.gov/servlets/purl/1491307.
@article{osti_1491307,
title = {Manifold learning of four-dimensional scanning transmission electron microscopy},
author = {Li, Xin and Dyck, Ondrej E. and Oxley, Mark P. and Lupini, Andrew R. and McInnes, Leland and Healy, John and Jesse, Stephen and Kalinin, Sergei V.},
abstractNote = {Four-dimensional scanning transmission electron microscopy (4D-STEM) of local atomic diffraction patterns is emerging as a powerful technique for probing intricate details of atomic structure and atomic electric fields. However, efficient processing and interpretation of large volumes of data remain challenging, especially for two-dimensional or light materials because the diffraction signal recorded on the pixelated arrays is weak. Here we employ data-driven manifold leaning approaches for straightforward visualization and exploration analysis of 4D-STEM datasets, distilling real-space neighboring effects on atomically resolved deflection patterns from single-layer graphene, with single dopant atoms, as recorded on a pixelated detector. These extracted patterns relate to both individual atom sites and sublattice structures, effectively discriminating single dopant anomalies via multi-mode views. We believe manifold learning analysis will accelerate physics discoveries coupled between data-rich imaging mechanisms and materials such as ferroelectric, topological spin, and van der Waals heterostructures.},
doi = {10.1038/s41524-018-0139-y},
journal = {npj Computational Materials},
number = 1,
volume = 5,
place = {United States},
year = {Mon Jan 07 00:00:00 EST 2019},
month = {Mon Jan 07 00:00:00 EST 2019}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 26 works
Citation information provided by
Web of Science

Figures / Tables:

Figure 1 Figure 1: Schematic of manifold learning of Ronchigram datasets. The low-dimensional physical parameter space (such as defocus, accelerating voltage, and material structure phases) is translated onto a high dimensional Ronchigram response space by the imaging mechanisms of microscope. High-dimensional and large-scale Ronchigram datasets are projected into a low-dimensional manifold spacemore » for efficiently revealing and hierarchically representing rich features. With extracted patterns from manifold learning, deeper study can be conducted via adaptive experiment design« less

Save / Share:

Works referenced in this record:

Nonstandard imaging methods in electron microscopy
journal, January 1976


Modified differential phase contrast Lorentz microscopy for improved imaging of magnetic structures
journal, January 1990

  • Chapman, J. N.; McFadyen, I. R.; McVitie, S.
  • IEEE Transactions on Magnetics, Vol. 26, Issue 5
  • DOI: 10.1109/20.104427

Big Data Analytics for Scanning Transmission Electron Microscopy Ptychography
journal, May 2016

  • Jesse, S.; Chi, M.; Belianinov, A.
  • Scientific Reports, Vol. 6, Issue 1
  • DOI: 10.1038/srep26348

Placing single atoms in graphene with a scanning transmission electron microscope
journal, September 2017

  • Dyck, Ondrej; Kim, Songkil; Kalinin, Sergei V.
  • Applied Physics Letters, Vol. 111, Issue 11
  • DOI: 10.1063/1.4998599

Direct atomic fabrication and dopant positioning in Si using electron beams with active real-time image-based feedback
journal, April 2018


Directed Atom-by-Atom Assembly of Dopants in Silicon
journal, May 2018


Multiclass spectral clustering
conference, January 2003

  • Yu,
  • ICCV 2003: 9th International Conference on Computer Vision, Proceedings Ninth IEEE International Conference on Computer Vision
  • DOI: 10.1109/ICCV.2003.1238361

Hierarchical Density Estimates for Data Clustering, Visualization, and Outlier Detection
journal, July 2015

  • Campello, Ricardo J. G. B.; Moulavi, Davoud; Zimek, Arthur
  • ACM Transactions on Knowledge Discovery from Data, Vol. 10, Issue 1
  • DOI: 10.1145/2733381

Visualizing Large-scale and High-dimensional Data
conference, January 2016

  • Tang, Jian; Liu, Jingzhou; Zhang, Ming
  • Proceedings of the 25th International Conference on World Wide Web - WWW '16
  • DOI: 10.1145/2872427.2883041

Ptychographic electron microscopy using high-angle dark-field scattering for sub-nanometre resolution imaging
journal, January 2012

  • Humphry, M. J.; Kraus, B.; Hurst, A. C.
  • Nature Communications, Vol. 3, Issue 1
  • DOI: 10.1038/ncomms1733

Convergent beam electron holography for analysis of van der Waals heterostructures
journal, July 2018

  • Latychevskaia, Tatiana; Woods, Colin Robert; Wang, Yi Bo
  • Proceedings of the National Academy of Sciences, Vol. 115, Issue 29
  • DOI: 10.1073/pnas.1722523115

Simultaneous atomic-resolution electron ptychography and Z-contrast imaging of light and heavy elements in complex nanostructures
journal, August 2016

  • Yang, H.; Rutte, R. N.; Jones, L.
  • Nature Communications, Vol. 7, Issue 1
  • DOI: 10.1038/ncomms12532

E-beam manipulation of Si atoms on graphene edges with an aberration-corrected scanning transmission electron microscope
journal, July 2018


Modelling the inelastic scattering of fast electrons
journal, April 2015


Efficient phase contrast imaging in STEM using a pixelated detector. Part 1: Experimental demonstration at atomic resolution
journal, April 2015


Efficient linear phase contrast in scanning transmission electron microscopy with matched illumination and detector interferometry
journal, February 2016

  • Ophus, Colin; Ciston, Jim; Pierce, Jordan
  • Nature Communications, Vol. 7, Issue 1
  • DOI: 10.1038/ncomms10719

Local and transient nanoscale strain mapping during in situ deformation
journal, August 2016

  • Gammer, C.; Kacher, J.; Czarnik, C.
  • Applied Physics Letters, Vol. 109, Issue 8
  • DOI: 10.1063/1.4961683

Differential phase contrast 2.0—Opening new “fields” for an established technique
journal, June 2012


Manipulating low-dimensional materials down to the level of single atoms with electron irradiation
journal, September 2017


Fire up the atom forge
journal, November 2016

  • Kalinin, Sergei V.; Borisevich, Albina; Jesse, Stephen
  • Nature, Vol. 539, Issue 7630
  • DOI: 10.1038/539485a

Deciphering chemical order/disorder and material properties at the single-atom level
journal, February 2017

  • Yang, Yongsoo; Chen, Chien-Chun; Scott, M. C.
  • Nature, Vol. 542, Issue 7639
  • DOI: 10.1038/nature21042

Mitigating e-beam-induced hydrocarbon deposition on graphene for atomic-scale scanning transmission electron microscopy studies
journal, January 2018

  • Dyck, Ondrej; Kim, Songkil; Kalinin, Sergei V.
  • Journal of Vacuum Science & Technology B, Nanotechnology and Microelectronics: Materials, Processing, Measurement, and Phenomena, Vol. 36, Issue 1
  • DOI: 10.1116/1.5003034

Electron-Beam Manipulation of Silicon Dopants in Graphene
journal, June 2018


hdbscan: Hierarchical density based clustering
journal, March 2017

  • McInnes, Leland; Healy, John; Astels, Steve
  • The Journal of Open Source Software, Vol. 2, Issue 11
  • DOI: 10.21105/joss.00205

Three-dimensional surface topography of graphene by divergent beam electron diffraction
journal, February 2017

  • Latychevskaia, Tatiana; Hsu, Wei-Hao; Chang, Wei-Tse
  • Nature Communications, Vol. 8, Issue 1
  • DOI: 10.1038/ncomms14440

Differential phase-contrast microscopy at atomic resolution
journal, June 2012

  • Shibata, Naoya; Findlay, Scott D.; Kohno, Yuji
  • Nature Physics, Vol. 8, Issue 8
  • DOI: 10.1038/nphys2337

New area detector for atomic-resolution scanning transmission electron microscopy
journal, April 2010

  • Shibata, N.; Kohno, Y.; Findlay, S. D.
  • Journal of Electron Microscopy, Vol. 59, Issue 6
  • DOI: 10.1093/jmicro/dfq014

The investigation of magnetic domain structures in thin foils by electron microscopy
journal, April 1984


Direct observation of Σ7 domain boundary core structure in magnetic skyrmion lattice
journal, February 2016


Random projection trees and low dimensional manifolds
conference, January 2008

  • Dasgupta, Sanjoy; Freund, Yoav
  • the 40th annual ACM symposium, Proceedings of the fourtieth annual ACM symposium on Theory of computing - STOC 08
  • DOI: 10.1145/1374376.1374452

Electric field imaging of single atoms
journal, May 2017

  • Shibata, Naoya; Seki, Takehito; Sánchez-Santolino, Gabriel
  • Nature Communications, Vol. 8, Issue 1
  • DOI: 10.1038/ncomms15631

Electron ptychographic microscopy for three-dimensional imaging
journal, July 2017


High-veracity functional imaging in scanning probe microscopy via Graph-Bootstrapping
journal, June 2018


Imaging of built-in electric field at a p-n junction by scanning transmission electron microscopy
journal, June 2015

  • Shibata, Naoya; Findlay, Scott D.; Sasaki, Hirokazu
  • Scientific Reports, Vol. 5, Issue 1
  • DOI: 10.1038/srep10040

Efficient k-nearest neighbor graph construction for generic similarity measures
conference, January 2011

  • Dong, Wei; Moses, Charikar; Li, Kai
  • Proceedings of the 20th international conference on World wide web - WWW '11
  • DOI: 10.1145/1963405.1963487

UMAP: Uniform Manifold Approximation and Projection
journal, September 2018

  • McInnes, Leland; Healy, John; Saul, Nathaniel
  • Journal of Open Source Software, Vol. 3, Issue 29
  • DOI: 10.21105/joss.00861

IL-33 expression in response to SARS-CoV-2 correlates with seropositivity in COVID-19 convalescent individuals
journal, April 2021


Modified differential phase contrast Lorentz Microscopy for improved imaging of magnetic structures
conference, January 1990


Convergent beam electron holography for analysis of van der Waals heterostructures
text, January 2018


Works referencing / citing this record:

A machine perspective of atomic defects in scanning transmission electron microscopy
journal, August 2019

  • Dan, Jiadong; Zhao, Xiaoxu; Pennycook, Stephen J.
  • InfoMat, Vol. 1, Issue 3
  • DOI: 10.1002/inf2.12026

Exploratory analysis of hyperspectral FTIR data obtained from environmental microplastics samples
journal, January 2020

  • Wander, Lukas; Vianello, Alvise; Vollertsen, Jes
  • Analytical Methods, Vol. 12, Issue 6
  • DOI: 10.1039/c9ay02483b

Artificial intelligence for materials discovery
journal, July 2019

  • Gomes, Carla P.; Selman, Bart; Gregoire, John M.
  • MRS Bulletin, Vol. 44, Issue 7
  • DOI: 10.1557/mrs.2019.158

Figures/Tables have been extracted from DOE-funded journal article accepted manuscripts.