Machine learning for automated experimentation in scanning transmission electron microscopy

Kalinin, Sergei V.; Mukherjee, Debangshu; Roccapriore, Kevin; Blaiszik, Benjamin J.; Ghosh, Ayana; Ziatdinov, Maxim A.; Al-Najjar, Anees; Doty, Christina; Akers, Sarah; Rao, Nageswara S.; Agar, Joshua C.; Spurgeon, Steven R.

doi:10.1038/s41524-023-01142-0

Title: Machine learning for automated experimentation in scanning transmission electron microscopy

Journal Article · 19 December 2023 · npj Computational Materials

DOI: https://doi.org/10.1038/s41524-023-01142-0 · OSTI ID:2246971

; Mukherjee, Debangshu; Roccapriore, Kevin;

;

; Al-Najjar, Anees; Doty, Christina;

; Rao, Nageswara S.;

;

Abstract Machine learning (ML) has become critical for post-acquisition data analysis in (scanning) transmission electron microscopy, (S)TEM, imaging and spectroscopy. An emerging trend is the transition to real-time analysis and closed-loop microscope operation. The effective use of ML in electron microscopy now requires the development of strategies for microscopy-centric experiment workflow design and optimization. Here, we discuss the associated challenges with the transition to active ML, including sequential data analysis and out-of-distribution drift effects, the requirements for edge operation, local and cloud data storage, and theory in the loop operations. Specifically, we discuss the relative contributions of human scientists and ML agents in the ideation, orchestration, and execution of experimental workflows, as well as the need to develop universal hyper languages that can apply across multiple platforms. These considerations will collectively inform the operationalization of ML in next-generation experimentation.

View Journal Article

Cite

Export

Save

Sponsoring Organization:: USDOE

Grant/Contract Number:: AC05-00OR22725; AC05-76RL01830; SC0002501

OSTI ID:: 2246971

Alternate ID(s):: OSTI ID: 2251636; OSTI ID: 2263339; OSTI ID: 2263340

Journal Information:: npj Computational Materials, Journal Name: npj Computational Materials Journal Issue: 1 Vol. 9; ISSN 2057-3960

Publisher:: Nature Publishing GroupCopyright Statement

Country of Publication:: United Kingdom

Language:: English

References (106)

Forecasting of in situ electron energy loss spectroscopy Lewis, Nicholas R.; Jin, Yicheng; Tang, Xiuyu npj Computational Materials, Vol. 8, Issue 1 https://doi.org/10.1038/s41524-022-00940-2	journal	December 2022
The abTEM code: transmission electron microscopy from first principles Madsen, Jacob; Susi, Toma Open Research Europe, Vol. 1 https://doi.org/10.12688/openreseurope.13015.1	journal	January 2021
Deep Learning Enabled Strain Mapping of Single-Atom Defects in Two-Dimensional Transition Metal Dichalcogenides with Sub-Picometer Precision Lee, Chia-Hao; Khan, Abid; Luo, Di Nano Letters, Vol. 20, Issue 5 https://doi.org/10.1021/acs.nanolett.0c00269	journal	April 2020
Big Data Analytics for Scanning Transmission Electron Microscopy Ptychography Jesse, S.; Chi, M.; Belianinov, A. Scientific Reports, Vol. 6, Issue 1 https://doi.org/10.1038/srep26348	journal	May 2016
Spontaneous Vortex Nanodomain Arrays at Ferroelectric Heterointerfaces Nelson, Christopher T.; Winchester, Benjamin; Zhang, Yi Nano Letters, Vol. 11, Issue 2 https://doi.org/10.1021/nl1041808	journal	February 2011
Mixed-state electron ptychography enables sub-angstrom resolution imaging with picometer precision at low dose Chen, Zhen; Odstrcil, Michal; Jiang, Yi Nature Communications, Vol. 11, Issue 1 https://doi.org/10.1038/s41467-020-16688-6	journal	June 2020
Ensemble Machine Learning Zhang, Cha; Ma, Yunqian https://doi.org/10.1007/978-1-4419-9326-7	book	January 2012
The future of atomic resolution electron microscopy for materials science Spence, J. C. H. Materials Science and Engineering: R: Reports, Vol. 26, Issue 1-2 https://doi.org/10.1016/S0927-796X(99)00005-4	journal	October 1999
Why it is Unfortunate that Linear Machine Learning “Works” so well in Electromechanical Switching of Ferroelectric Thin Films Qin, Shuyu; Guo, Yichen; Kaliyev, Alibek T. Advanced Materials, Vol. 34, Issue 47 https://doi.org/10.1002/adma.202202814	journal	October 2022
Ensemble learning-iterative training machine learning for uncertainty quantification and automated experiment in atom-resolved microscopy Ghosh, Ayana; Sumpter, Bobby G.; Dyck, Ondrej npj Computational Materials, Vol. 7, Issue 1 https://doi.org/10.1038/s41524-021-00569-7	journal	July 2021
Data-driven discovery of coordinates and governing equations Champion, Kathleen; Lusch, Bethany; Kutz, J. Nathan Proceedings of the National Academy of Sciences, Vol. 116, Issue 45 https://doi.org/10.1073/pnas.1906995116	journal	October 2019
Fast inference of deep neural networks in FPGAs for particle physics Duarte, J.; Han, S.; Harris, P. Journal of Instrumentation, Vol. 13, Issue 07 https://doi.org/10.1088/1748-0221/13/07/P07027	journal	July 2018
Artificial intelligence and pattern recognition techniques in microscope image processing and analysis Bonnet, Noël Advances in Imaging and Electron Physics https://doi.org/10.1016/S1076-5670(00)80020-8	book	January 2000
Disentangling ferroelectric domain wall geometries and pathways in dynamic piezoresponse force microscopy via unsupervised machine learning Kalinin, Sergei V.; Steffes, James J.; Liu, Yongtao Nanotechnology, Vol. 33, Issue 5 https://doi.org/10.1088/1361-6528/ac2f5b	journal	November 2021
What’s in a Name Change? Martin, Joseph D. Physics in Perspective, Vol. 17, Issue 1 https://doi.org/10.1007/s00016-014-0151-7	journal	January 2015
Virtual Infrastructure Twin for Computing-Instrument Ecosystems: Software and Measurements Al-Najjar, Anees; Rao, Nageswara S. V. IEEE Access, Vol. 11 https://doi.org/10.1109/ACCESS.2023.3246954	journal	January 2023
Spectroscopic Imaging of Single Atoms Within a Bulk Solid Varela, M.; Findlay, S. D.; Lupini, A. R. Physical Review Letters, Vol. 92, Issue 9 https://doi.org/10.1103/PhysRevLett.92.095502	journal	March 2004
Learning surface molecular structures via machine vision Ziatdinov, Maxim; Maksov, Artem; Kalinin, Sergei V. npj Computational Materials, Vol. 3, Issue 1 https://doi.org/10.1038/s41524-017-0038-7	journal	August 2017
Clustering analysis strategies for electron energy loss spectroscopy (EELS) Torruella, Pau; Estrader, Marta; López-Ortega, Alberto Ultramicroscopy, Vol. 185 https://doi.org/10.1016/j.ultramic.2017.11.010	journal	February 2018
Atomic-scale measurement of polar entropy Mukherjee, Debangshu; Prokhorenko, Sergei; Miao, Leixin Physical Review B, Vol. 100, Issue 10 https://doi.org/10.1103/PhysRevB.100.104102	journal	September 2019
Off-the-shelf deep learning is not enough, and requires parsimony, Bayesianity, and causality Vasudevan, Rama K.; Ziatdinov, Maxim; Vlcek, Lukas npj Computational Materials, Vol. 7, Issue 1 https://doi.org/10.1038/s41524-020-00487-0	journal	January 2021
mpfit: a robust method for fitting atomic resolution images with multiple Gaussian peaks Mukherjee, Debangshu; Miao, Leixin; Stone, Greg Advanced Structural and Chemical Imaging, Vol. 6, Issue 1 https://doi.org/10.1186/s40679-020-0068-y	journal	January 2020
Advanced Computing in Electron Microscopy Kirkland, Earl J. https://doi.org/10.1007/978-1-4757-4406-4	book	January 1998
Disentangling multiple scattering with deep learning: application to strain mapping from electron diffraction patterns Munshi, Joydeep; Rakowski, Alexander; Savitzky, Benjamin H. npj Computational Materials, Vol. 8, Issue 1 https://doi.org/10.1038/s41524-022-00939-9	journal	December 2022
Sculpting the Plasmonic Responses of Nanoparticles by Directed Electron Beam Irradiation Roccapriore, Kevin M.; Cho, Shin‐Hum; Lupini, Andrew R. Small, Vol. 18, Issue 1 https://doi.org/10.1002/smll.202105099	journal	November 2021
Better, Faster, and Less Biased Machine Learning: Electromechanical Switching in Ferroelectric Thin Films Griffin, Lee A.; Gaponenko, Iaroslav; Bassiri‐Gharb, Nazanin Advanced Materials, Vol. 32, Issue 38 https://doi.org/10.1002/adma.202002425	journal	August 2020
Stability of Polar Vortex Lattice in Ferroelectric Superlattices Hong, Zijian; Damodaran, Anoop R.; Xue, Fei Nano Letters, Vol. 17, Issue 4 https://doi.org/10.1021/acs.nanolett.6b04875	journal	March 2017
Big–deep–smart data in imaging for guiding materials design Kalinin, Sergei V.; Sumpter, Bobby G.; Archibald, Richard K. Nature Materials, Vol. 14, Issue 10 https://doi.org/10.1038/nmat4395	journal	September 2015
Transmission Electron Microscopy Williams, David B.; Carter, C. Barry https://doi.org/10.1007/978-1-4757-2519-3	book	January 1996
Simultaneous inversion of optical and infra-red image data to determine thermo-mechanical properties of thermally conductive solid materials Cottrill, Anton L.; Goulet, Remi; Fremy, Flavien International Journal of Heat and Mass Transfer, Vol. 163 https://doi.org/10.1016/j.ijheatmasstransfer.2020.120445	journal	December 2020
Synchrotron Radiation in Materials Science Fan, Chunhai; Zhao, Zhentang https://doi.org/10.1002/9783527697106	book	February 2018
Phase-contrast X-ray imaging with synchrotron radiation for materials science applications Stevenson, A. W.; Gureyev, T. E.; Paganin, D. Nuclear Instruments and Methods in Physics Research Section B: Beam Interactions with Materials and Atoms, Vol. 199, p. 427-435 https://doi.org/10.1016/S0168-583X(02)01557-4	journal	January 2003
Causal analysis of competing atomistic mechanisms in ferroelectric materials from high-resolution scanning transmission electron microscopy data Ziatdinov, Maxim; Nelson, Christopher T.; Zhang, Xiaohang npj Computational Materials, Vol. 6, Issue 1 https://doi.org/10.1038/s41524-020-00396-2	journal	August 2020
Ingrained: An Automated Framework for Fusing Atomic‐Scale Image Simulations into Experiments Schwenker, Eric; Kolluru, Venkata Surya Chaitanya; Guo, Jinglong Small https://doi.org/10.1002/smll.202102960	journal	April 2022
Correcting nonlinear drift distortion of scanning probe and scanning transmission electron microscopies from image pairs with orthogonal scan directions Ophus, Colin; Ciston, Jim; Nelson, Chris T. Ultramicroscopy, Vol. 162 https://doi.org/10.1016/j.ultramic.2015.12.002	journal	March 2016
Automated Experiment in 4D-STEM: Exploring Emergent Physics and Structural Behaviors Roccapriore, Kevin M.; Dyck, Ondrej; Oxley, Mark P. ACS Nano, Vol. 16, Issue 5 https://doi.org/10.1021/acsnano.1c11118	journal	April 2022
Polar metals by geometric design Kim, T. H.; Puggioni, D.; Yuan, Y. Nature, Vol. 533, Issue 7601 https://doi.org/10.1038/nature17628	journal	April 2016
Revolving scanning transmission electron microscopy: Correcting sample drift distortion without prior knowledge Sang, Xiahan; LeBeau, James M. Ultramicroscopy, Vol. 138 https://doi.org/10.1016/j.ultramic.2013.12.004	journal	March 2014
Scanning Transmission Electron Microscopy Pennycook, Stephen J.; Nellist, Peter D. https://doi.org/10.1007/978-1-4419-7200-2	book	January 2011
A Primer to Single-Particle Cryo-Electron Microscopy Cheng, Yifan; Grigorieff, Nikolaus; Penczek, Pawel A. Cell, Vol. 161, Issue 3 https://doi.org/10.1016/j.cell.2015.03.050	journal	April 2015
Atomic-Level Sculpting of Crystalline Oxides: Toward Bulk Nanofabrication with Single Atomic Plane Precision Jesse, Stephen; He, Qian; Lupini, Andrew R. Small, Vol. 11, Issue 44 https://doi.org/10.1002/smll.201502048	journal	October 2015
Enabling Autonomous Electron Microscopy for Networked Computation and Steering Al-Najjar, Anees; Rao, Nageswara S. V.; Sankaran, Ramanan 2022 IEEE 18th International Conference on e-Science (e-Science) https://doi.org/10.1109/eScience55777.2022.00040	conference	October 2022
Three-dimensional imaging of dislocations in a nanoparticle at atomic resolution Chen, Chien-Chun; Zhu, Chun; White, Edward R. Nature, Vol. 496, Issue 7443 https://doi.org/10.1038/nature12009	journal	March 2013
Identification and correction of temporal and spatial distortions in scanning transmission electron microscopy Roccapriore, Kevin M.; Creange, Nicole; Ziatdinov, Maxim Ultramicroscopy, Vol. 229 https://doi.org/10.1016/j.ultramic.2021.113337	journal	October 2021
Dynamic scan control in STEM: spiral scans Sang, Xiahan; Lupini, Andrew R.; Unocic, Raymond R. Advanced Structural and Chemical Imaging, Vol. 2, Issue 1 https://doi.org/10.1186/s40679-016-0020-3	journal	June 2016
Deep Bayesian local crystallography Kalinin, Sergei V.; Oxley, Mark P.; Valleti, Mani npj Computational Materials, Vol. 7, Issue 1 https://doi.org/10.1038/s41524-021-00621-6	journal	November 2021
A Roadmap for Edge Computing Enabled Automated Multidimensional Transmission Electron Microscopy Mukherjee, Debangshu; Roccapriore, Kevin M.; Al-Najjar, Anees Microscopy Today, Vol. 30, Issue 6 https://doi.org/10.1017/S1551929522001286	journal	November 2022
Hybrid Improper Ferroelectricity: A Mechanism for Controllable Polarization-Magnetization Coupling Benedek, Nicole A.; Fennie, Craig J. Physical Review Letters, Vol. 106, Issue 10 https://doi.org/10.1103/PhysRevLett.106.107204	journal	March 2011
Software tools for automated transmission electron microscopy Schorb, Martin; Haberbosch, Isabella; Hagen, Wim J. H. Nature Methods, Vol. 16, Issue 6 https://doi.org/10.1038/s41592-019-0396-9	journal	May 2019
Atomic scale imaging of competing polar states in a Ruddlesden–Popper layered oxide Stone, Greg; Ophus, Colin; Birol, Turan Nature Communications, Vol. 7, Issue 1 https://doi.org/10.1038/ncomms12572	journal	August 2016
AutoPhaseNN: unsupervised physics-aware deep learning of 3D nanoscale Bragg coherent diffraction imaging Yao, Yudong; Chan, Henry; Sankaranarayanan, Subramanian npj Computational Materials, Vol. 8, Issue 1 https://doi.org/10.1038/s41524-022-00803-w	journal	June 2022
A Style-Based Generator Architecture for Generative Adversarial Networks Karras, Tero; Laine, Samuli; Aila, Timo 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2019.00453	conference	June 2019
Machine learning in scanning transmission electron microscopy Kalinin, Sergei V.; Ophus, Colin; Voyles, Paul M. Nature Reviews Methods Primers, Vol. 2, Issue 1 https://doi.org/10.1038/s43586-022-00095-w	journal	March 2022
Lattice light-sheet microscopy: Imaging molecules to embryos at high spatiotemporal resolution Chen, Bi-Chang; Legant, Wesley R.; Wang, Kai Science, Vol. 346, Issue 6208 https://doi.org/10.1126/science.1257998	journal	October 2014
Mapping chemical and bonding information using multivariate analysis of electron energy-loss spectrum images Bosman, M.; Watanabe, M.; Alexander, D. T. L. Ultramicroscopy, Vol. 106, Issue 11-12, p. 1024-1032 https://doi.org/10.1016/j.ultramic.2006.04.016	journal	October 2006
Exploring Mesoscopic Physics of Vacancy-Ordered Systems through Atomic Scale Observations of Topological Defects Borisevich, A. Y.; Morozovska, A. N.; Kim, Young-Min Physical Review Letters, Vol. 109, Issue 6 https://doi.org/10.1103/PhysRevLett.109.065702	journal	August 2012
Atomic-Scale Compensation Phenomena at Polar Interfaces Chisholm, Matthew F.; Luo, Weidong; Oxley, Mark P. Physical Review Letters, Vol. 105, Issue 19 https://doi.org/10.1103/PhysRevLett.105.197602	journal	November 2010
Observation of polar vortices in oxide superlattices Yadav, A. K.; Nelson, C. T.; Hsu, S. L. Nature, Vol. 530, Issue 7589 https://doi.org/10.1038/nature16463	journal	January 2016
Data-driven discovery of partial differential equations Rudy, Samuel H.; Brunton, Steven L.; Proctor, Joshua L. Science Advances, Vol. 3, Issue 4 https://doi.org/10.1126/sciadv.1602614	journal	April 2017
USID and Pycroscopy – Open Source Frameworks for Storing and Analyzing Imaging and Spectroscopy Data Somnath, Suhas; Smith, Chris R.; Laanait, Nouamane Microscopy and Microanalysis, Vol. 25, Issue S2 https://doi.org/10.1017/S1431927619001831	journal	August 2019
Analysis of Interpretable Data Representations for 4D-STEM Using Unsupervised Learning Bruefach, Alexandra; Ophus, Colin; Scott, Mary C. Microscopy and Microanalysis, Vol. 28, Issue 6 https://doi.org/10.1017/S1431927622012259	journal	December 2022
Upper limits for the residual aberrations of a high-resolution aberration-corrected STEM Haider, M.; Uhlemann, S.; Zach, J. Ultramicroscopy, Vol. 81, Issue 3-4 https://doi.org/10.1016/S0304-3991(99)00194-1	journal	April 2000
Principal component and spatial correlation analysis of spectroscopic-imaging data in scanning probe microscopy Jesse, Stephen; Kalinin, Sergei V. Nanotechnology, Vol. 20, Issue 8 https://doi.org/10.1088/0957-4484/20/8/085714	journal	February 2009
Strain Mapping of Two-Dimensional Heterostructures with Subpicometer Precision Han, Yimo; Nguyen, Kayla; Cao, Michael Nano Letters, Vol. 18, Issue 6 https://doi.org/10.1021/acs.nanolett.8b00952	journal	May 2018
Probing Electron Beam Induced Transformations on a Single-Defect Level via Automated Scanning Transmission Electron Microscopy Roccapriore, Kevin M.; Boebinger, Matthew G.; Dyck, Ondrej ACS Nano, Vol. 16, Issue 10 https://doi.org/10.1021/acsnano.2c07451	journal	October 2022
Scanning transmission electron microscopy* Crewe, Albert V. Journal of Microscopy, Vol. 100, Issue 3 https://doi.org/10.1111/j.1365-2818.1974.tb03937.x	journal	April 1974
A Synchrotron in a Microscope Brown, L. M. Electron Microscopy and Analysis 1997 https://doi.org/10.1201/9781003063056-4	book	January 2022
Automated and Autonomous Experiments in Electron and Scanning Probe Microscopy Kalinin, Sergei V.; Ziatdinov, Maxim; Hinkle, Jacob ACS Nano, Vol. 15, Issue 8 https://doi.org/10.1021/acsnano.1c02104	journal	July 2021
Octahedral Rotation-Induced Ferroelectricity in Cation Ordered Perovskites Rondinelli, James M.; Fennie, Craig J. Advanced Materials, Vol. 24, Issue 15 https://doi.org/10.1002/adma.201104674	journal	April 2012
Learning from data to design functional materials without inversion symmetry Balachandran, Prasanna V.; Young, Joshua; Lookman, Turab Nature Communications, Vol. 8, Issue 1 https://doi.org/10.1038/ncomms14282	journal	February 2017
Atomic-Resolution STEM Imaging of Graphene at Low Voltage of 30 kV with Resolution Enhancement by Using Large Convergence Angle Sawada, H.; Sasaki, T.; Hosokawa, F. Physical Review Letters, Vol. 114, Issue 16 https://doi.org/10.1103/PhysRevLett.114.166102	journal	April 2015
Imaging atomic-scale chemistry from fused multi-modal electron microscopy Schwartz, Jonathan; Di, Zichao Wendy; Jiang, Yi npj Computational Materials, Vol. 8, Issue 1 https://doi.org/10.1038/s41524-021-00692-5	journal	January 2022
Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations Ziatdinov, Maxim; Dyck, Ondrej; Maksov, Artem ACS Nano, Vol. 11, Issue 12 https://doi.org/10.1021/acsnano.7b07504	journal	October 2016
The impact of STEM aberration correction on materials science Pennycook, Stephen J. Ultramicroscopy, Vol. 180 https://doi.org/10.1016/j.ultramic.2017.03.020	journal	September 2017
An open-source microscopy framework for simultaneous control of image acquisition, reconstruction, and analysis Casas Moreno, Xavier; Silva, Mariline Mendes; Roos, Johannes HardwareX, Vol. 13 https://doi.org/10.1016/j.ohx.2023.e00400	journal	March 2023
Lattice imaging at an accelerating voltage of 30kV using an in-lens type cold field-emission scanning electron microscope Konno, Mitsuru; Ogashiwa, Takeshi; Sunaoshi, Takeshi Ultramicroscopy, Vol. 145 https://doi.org/10.1016/j.ultramic.2013.09.001	journal	October 2014
Single-particle cryo-EM at atomic resolution Nakane, Takanori; Kotecha, Abhay; Sente, Andrija Nature, Vol. 587, Issue 7832 https://doi.org/10.1038/s41586-020-2829-0	journal	October 2020
BEAM: A Computational Workflow System for Managing and Modeling Material Characterization Data in HPC Environments Lingerfelt, E. J.; Belianinov, A.; Endeve, E. Procedia Computer Science, Vol. 80 https://doi.org/10.1016/j.procs.2016.05.410	journal	January 2016
Evaluating Stage Motion for Automated Electron Microscopy Fiedler, Kevin R.; Olszta, Matthew J.; Yano, Kayla H. Microscopy and Microanalysis https://doi.org/10.1093/micmic/ozad108	journal	October 2023
AI-enabled high-resolution scanning coherent diffraction imaging Cherukara, Mathew J.; Zhou, Tao; Nashed, Youssef Applied Physics Letters, Vol. 117, Issue 4 https://doi.org/10.1063/5.0013065	journal	July 2020
Electron ptychography of 2D materials to deep sub-ångström resolution Jiang, Yi; Chen, Zhen; Han, Yimo Nature, Vol. 559, Issue 7714 https://doi.org/10.1038/s41586-018-0298-5	journal	July 2018
Editorial: Method and Data Sharing and Reproducibility of Scientific Results Merz, Kenneth M.; Amaro, Rommie; Cournia, Zoe Journal of Chemical Information and Modeling, Vol. 60, Issue 12 https://doi.org/10.1021/acs.jcim.0c01389	journal	December 2020
Turning ABO ₃ Antiferroelectrics into Ferroelectrics: Design Rules for Practical Rotation-Driven Ferroelectricity in Double Perovskites and A ₃ B ₂ O ₇ Ruddlesden-Popper Compounds Mulder, Andrew T.; Benedek, Nicole A.; Rondinelli, James M. Advanced Functional Materials https://doi.org/10.1002/adfm.201300210	journal	May 2013
Phases and Interfaces from Real Space Atomically Resolved Data: Physics-Based Deep Data Image Analysis Vasudevan, Rama K.; Ziatdinov, Maxim; Jesse, Stephen Nano Letters, Vol. 16, Issue 9 https://doi.org/10.1021/acs.nanolett.6b02130	journal	August 2016
Data mining graphene: correlative analysis of structure and electronic degrees of freedom in graphenic monolayers with defects Ziatdinov, Maxim; Fujii, Shintaro; Kiguchi, Manabu Nanotechnology, Vol. 27, Issue 49 https://doi.org/10.1088/0957-4484/27/49/495703	journal	November 2016
Identifying and Correcting Scan Noise and Drift in the Scanning Transmission Electron Microscope Jones, Lewys; Nellist, Peter D. Microscopy and Microanalysis, Vol. 19, Issue 4 https://doi.org/10.1017/S1431927613001402	journal	May 2013
Automatic parameter selection for electron ptychography via Bayesian optimization Cao, Michael C.; Chen, Zhen; Jiang, Yi Scientific Reports, Vol. 12, Issue 1 https://doi.org/10.1038/s41598-022-16041-5	journal	July 2022
Quantification of flexoelectricity in PbTiO3/SrTiO3 superlattice polar vortices using machine learning and phase-field modeling Li, Q.; Nelson, C. T.; Hsu, S. -L. Nature Communications, Vol. 8, Issue 1 https://doi.org/10.1038/s41467-017-01733-8	journal	November 2017
Exploring order parameters and dynamic processes in disordered systems via variational autoencoders Kalinin, Sergei V.; Dyck, Ondrej; Jesse, Stephen Science Advances, Vol. 7, Issue 17 https://doi.org/10.1126/sciadv.abd5084	journal	April 2021
Direct-write liquid phase transformations with a scanning transmission electron microscope Unocic, Raymond R.; Lupini, Andrew R.; Borisevich, Albina Y. Nanoscale, Vol. 8, Issue 34 https://doi.org/10.1039/C6NR04994J	journal	January 2016
Multivariate statistical methods for the analysis of microscope image series: applications in materials science Bonnet, N. Journal of Microscopy, Vol. 190, Issue 1‐2 https://doi.org/10.1046/j.1365-2818.1998.3250876.x	journal	April 1998
Rapid and flexible segmentation of electron microscopy data using few-shot machine learning Akers, Sarah; Kautz, Elizabeth; Trevino-Gavito, Andrea npj Computational Materials, Vol. 7, Issue 1 https://doi.org/10.1038/s41524-021-00652-z	journal	November 2021
Insights into Cation Ordering of Double Perovskite Oxides from Machine Learning and Causal Relations Ghosh, Ayana; Palanichamy, Gayathri; Trujillo, Dennis P. Chemistry of Materials, Vol. 34, Issue 16 https://doi.org/10.1021/acs.chemmater.2c00217	journal	August 2022
The Naked Chip: No trade secret or hardware trojan can hide from ptychographic X-ray laminography Levi, Anthony F. J.; Aeppli, Gabriel IEEE Spectrum, Vol. 59, Issue 5 https://doi.org/10.1109/MSPEC.2022.9771357	journal	May 2022
Physics Discovery in Nanoplasmonic Systems via Autonomous Experiments in Scanning Transmission Electron Microscopy Roccapriore, Kevin M.; Kalinin, Sergei V.; Ziatdinov, Maxim Advanced Science, Vol. 9, Issue 36 https://doi.org/10.1002/advs.202203422	journal	November 2022
FINN: A Framework for Fast, Scalable Binarized Neural Network Inference Umuroglu, Yaman; Fraser, Nicholas J.; Gambardella, Giulio Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays - FPGA '17 https://doi.org/10.1145/3020078.3021744	conference	January 2017
Design of a graphical user interface for few-shot machine learning classification of electron microscopy data Doty, Christina; Gallagher, Shaun; Cui, Wenqi Computational Materials Science, Vol. 203 https://doi.org/10.1016/j.commatsci.2021.111121	journal	February 2022
Revealing ferroelectric switching character using deep recurrent neural networks Agar, Joshua C.; Naul, Brett; Pandya, Shishir Nature Communications, Vol. 10, Issue 1 https://doi.org/10.1038/s41467-019-12750-0	journal	October 2019
An Automated Scanning Transmission Electron Microscope Guided by Sparse Data Analytics Olszta, Matthew; Hopkins, Derek; Fiedler, Kevin R. Microscopy and Microanalysis https://doi.org/10.1017/S1431927622012065	journal	June 2022
Atom-by-Atom Direct Writing Dyck, Ondrej; Lupini, Andrew R.; Jesse, Stephen Nano Letters, Vol. 23, Issue 6 https://doi.org/10.1021/acs.nanolett.3c00114	journal	March 2023
Four-Dimensional Scanning Transmission Electron Microscopy (4D-STEM): From Scanning Nanodiffraction to Ptychography and Beyond Ophus, Colin Microscopy and Microanalysis, Vol. 25, Issue 3 https://doi.org/10.1017/S1431927619000497	journal	May 2019
The principles and interpretation of annular dark-field Z-contrast imaging Nellist, P. D.; Pennycook, S. J. Advances in Imaging and Electron Physics https://doi.org/10.1016/S1076-5670(00)80013-0	book	January 2000
Analytical transmission electron microscopy for emerging advanced materials Lin, Yue; Zhou, Min; Tai, Xiaolin Matter, Vol. 4, Issue 7 https://doi.org/10.1016/j.matt.2021.05.005	journal	July 2021
Imaging Intracellular Fluorescent Proteins at Nanometer Resolution Betzig, E.; Patterson, G. H.; Sougrat, R. Science, Vol. 313, Issue 5793 https://doi.org/10.1126/science.1127344	journal	September 2006
Twenty years after: How “Aberration correction in the STEM” truly placed a “A synchrotron in a Microscope” Ramasse, Quentin M. Ultramicroscopy, Vol. 180 https://doi.org/10.1016/j.ultramic.2017.03.016	journal	September 2017
Aberration correction in the STEM Krivanek, O. L.; Dellby, N.; Spence, A. J. Electron Microscopy and Analysis 1997 https://doi.org/10.1201/9781003063056-8	book	January 2022

Similar Records

Towards automating structural discovery in scanning transmission electron microscopy ^*

Journal Article · 2022 · Machine Learning: Science and Technology · OSTI ID:1844793

Creange, Nicole; Dyck, Ondrej; Vasudevan, Rama K.; +2 more

Automated and Autonomous Experiments in Electron and Scanning Probe Microscopy

Journal Article · 2021 · ACS Nano · OSTI ID:1813222

Kalinin, Sergei V.; Ziatdinov, Maxim; Jesse, Stephen; +6 more

An Automated Scanning Transmission Electron Microscope Guided by Sparse Data Analytics

Journal Article · 2022 · Microscopy and Microanalysis · OSTI ID:1873446

Olszta, Matthew; Hopkins, Derek; Fiedler, Kevin R.; +3 more

Title: Machine learning for automated experimentation in scanning transmission electron microscopy

Citation Formats

References (106)

Similar Records

Related Subjects