Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Machine Learning for Optical Scanning Probe Nanoscopy

Journal Article · · Advanced Materials
 [1];  [2];  [2];  [3];  [2];  [2];  [3];  [2];  [4];  [2]
  1. Department of Physics and Astronomy Stony Brook University Stony Brook NY 11794 USA
  2. Department of Physics Columbia University New York NY 10027 USA
  3. Department of Physics University of California at San Diego La Jolla CA 92093‐0319 USA
  4. Department of Physics and Astronomy Stony Brook University Stony Brook NY 11794 USA, National Synchrotron Light Source II Brookhaven National Laboratory Upton NY 11973 USA
Abstract

The ability to perform nanometer‐scale optical imaging and spectroscopy is key to deciphering the low‐energy effects in quantum materials, as well as vibrational fingerprints in planetary and extraterrestrial particles, catalytic substances, and aqueous biological samples. These tasks can be accomplished by the scattering‐type scanning near‐field optical microscopy (s‐SNOM) technique that has recently spread to many research fields and enabled notable discoveries. Herein, it is shown that the s‐SNOM, together with scanning probe research in general, can benefit in many ways from artificial‐intelligence (AI) and machine‐learning (ML) algorithms. Augmented with AI‐ and ML‐enhanced data acquisition and analysis, scanning probe optical nanoscopy is poised to become more efficient, accurate, and intelligent.

Sponsoring Organization:
USDOE
Grant/Contract Number:
SC0012704; SC0019443
OSTI ID:
1995866
Journal Information:
Advanced Materials, Journal Name: Advanced Materials; ISSN 0935-9648
Publisher:
Wiley Blackwell (John Wiley & Sons)Copyright Statement
Country of Publication:
Germany
Language:
English

References (208)

Inducing and Probing Localized Excitons in Atomically Thin Semiconductors via Tip‐Enhanced Cavity‐Spectroscopy journal June 2021
Modern Scattering‐Type Scanning Near‐Field Optical Microscopy for Advanced Material Research journal April 2019
Visualizing Atomically Layered Magnetism in CrSBr journal May 2022
Hypothesis Learning in Automated Experiment: Application to Combinatorial Materials Libraries journal April 2022
Tip-enhanced Raman spectroscopy - an interlaboratory reproducibility and comparison study: TERS interlaboratory comparison journal January 2014
Terahertz spectroscopy and imaging - Modern techniques and applications journal October 2010
Rapid Classification of Quantum Sources Enabled by Machine Learning journal September 2020
Fast Scanning Probe Microscopy via Machine Learning: Non‐Rectangular Scans with Compressed Sensing and Gaussian Process Optimization journal August 2020
ImageNet Large Scale Visual Recognition Challenge journal April 2015
Enhanced dielectric contrast in scattering-type scanning near-field optical microscopy journal August 2000
Artificial intelligence and pattern recognition techniques in microscope image processing and analysis book January 2000
Machine learning based on holographic scattering spectrum for mixed pollutants analysis journal January 2021
Probing the local dielectric function of WS2 on an Au substrate by near field optical microscopy operating in the visible spectral range journal February 2022
PPINN: Parareal physics-informed neural network for time-dependent PDEs journal October 2020
Automated tip functionalization via machine learning in scanning probe microscopy journal April 2022
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations journal February 2019
Some trends in microscope image processing journal December 2004
Space-filling scan paths and Gaussian process-aided adaptive sampling for efficient surface measurements journal October 2018
Fast and Accurate Uncertainty Estimation in Chemical Machine Learning journal November 2018
Combined Tip-Enhanced Raman Spectroscopy and Scattering-Type Scanning Near-Field Optical Microscopy journal June 2018
Deep Learning Enabled Strain Mapping of Single-Atom Defects in Two-Dimensional Transition Metal Dichalcogenides with Sub-Picometer Precision journal April 2020
Phonon Polaritons in Twisted Double-Layers of Hyperbolic van der Waals Crystals journal June 2020
Quantitative Nanoinfrared Spectroscopy of Anisotropic van der Waals Materials journal September 2020
Automated Searching and Identification of Self-Organized Nanostructures journal August 2020
Charge-Transfer Plasmon Polaritons at Graphene/α-RuCl 3 Interfaces journal November 2020
Amplitude- and Phase-Resolved Infrared Nanoimaging and Nanospectroscopy of Polaritons in a Liquid Environment journal January 2021
Long-Lived Phonon Polaritons in Hyperbolic Materials journal June 2021
Hybrid Tip-Enhanced Nanospectroscopy and Nanoimaging of Monolayer WSe 2 with Local Strain Control journal March 2016
Nanoscale Near-Field Tomography of Surface States on (Bi 0.5 Sb 0.5 ) 2 Te 3 journal November 2018
Logarithm Diameter Scaling and Carrier Density Independence of One-Dimensional Luttinger Liquid Plasmon journal March 2019
Global Optimization of Dielectric Metasurfaces Using a Physics-Driven Neural Network journal July 2019
Refractive Index-Based Control of Hyperbolic Phonon-Polariton Propagation journal September 2019
Photodegradation Protection in 2D In-Plane Heterostructures Revealed by Hyperspectral Nanoimaging: The Role of Nanointerface 2D Alloys journal January 2021
Bayesian Learning of Adatom Interactions from Atomically Resolved Imaging Data journal June 2021
Automated and Autonomous Experiments in Electron and Scanning Probe Microscopy journal July 2021
Revealing the Chemical Bonding in Adatom Arrays via Machine Learning of Hyperspectral Scanning Tunneling Spectroscopy Data journal June 2021
Deep Learning Analysis of Polaritonic Wave Images journal October 2021
Exploring Causal Physical Mechanisms via Non-Gaussian Linear Models and Deep Kernel Learning: Applications for Ferroelectric Domain Structures journal December 2021
Autonomous Scanning Probe Microscopy in Situ Tip Conditioning through Machine Learning journal May 2018
Physics-Based Approach for a Neural Networks Enabled Design of All-Dielectric Metasurfaces journal July 2020
Machine Learning for Integrated Quantum Photonics journal December 2020
Elucidating the Behavior of Nanophotonic Structures through Explainable Machine Learning Algorithms journal July 2020
Machine Learning-Based Diffractive Image Analysis with Subwavelength Resolution journal April 2021
Hybrid Machine Learning for Scanning Near-Field Optical Spectroscopy journal September 2021
Nonlocal Time-Resolved Terahertz Spectroscopy in the Near Field journal October 2021
Deep Learning Enhanced Mobile-Phone Microscopy journal March 2018
Far Infrared Synchrotron Near-Field Nanoimaging and Nanospectroscopy journal December 2017
A Deep Learning Approach for Objective-Driven All-Dielectric Metasurface Design journal November 2019
Quantifying Nanoscale Electromagnetic Fields in Near-Field Microscopy by Fourier Demodulation Analysis journal January 2020
THz Near-Field Imaging of Extreme Subwavelength Metal Structures journal January 2020
Adiabatic Tip-Plasmon Focusing for Nano-Raman Spectroscopy journal November 2010
Quantitative Measurement of Local Infrared Absorption and Dielectric Function with Tip-Enhanced Near-Field Microscopy journal April 2013
Infrared Nanoscopy of Dirac Plasmons at the Graphene–SiO 2 Interface journal October 2011
Ultrafast and Nanoscale Plasmonic Phenomena in Exfoliated Graphene Revealed by Infrared Pump–Probe Nanoscopy journal January 2014
Recovery of Permittivity and Depth from Near-Field Data as a Step toward Infrared Nanotomography journal June 2014
Mid-infrared Polaritonic Coupling between Boron Nitride Nanotubes and Graphene journal November 2014
Near-field probing of vibrational absorption for chemical microscopy journal May 1999
Phonon-enhanced light–matter interaction at the nanometre scale journal July 2002
Gate-tuning of graphene plasmons revealed by infrared nano-imaging journal June 2012
Optical nano-imaging of gate-tunable graphene plasmons journal June 2012
Fast automated analysis of strong gravitational lenses with convolutional neural networks journal August 2017
Correlated insulator behaviour at half-filling in magic-angle graphene superlattices journal March 2018
Unconventional superconductivity in magic-angle graphene superlattices journal March 2018
Deep learning massively accelerates super-resolution localization microscopy journal April 2018
Organic structure determination using atomic-resolution scanning probe microscopy journal August 2010
Atomic-scale observation of structural and electronic orders in the layered compound α-RuCl3 journal December 2016
Spatial complexity due to bulk electronic nematicity in a superconducting underdoped cuprate journal January 2012
Searching for exotic particles in high-energy physics with deep learning journal July 2014
Highly confined low-loss plasmons in graphene–boron nitride heterostructures journal December 2014
Polaritons in layered two-dimensional materials journal November 2016
Ultrafast multi-terahertz nano-spectroscopy with sub-cycle temporal resolution journal October 2014
Ultrafast optical switching of infrared plasmon polaritons in high-mobility graphene journal March 2016
Temporal correlations of superconductivity above the transition temperature in La2−xSrxCuO4 probed by terahertz spectroscopy journal February 2011
Visualization of electron nematicity and unidirectional antiferroic fluctuations at high temperatures in NaFeAs journal February 2014
Nanotextured phase coexistence in the correlated insulator V2O3 journal September 2016
Machine learning phases of matter journal February 2017
Imaging the nanoscale phase separation in vanadium dioxide thin films at terahertz frequencies journal September 2018
Scale-invariant magnetic textures in the strongly correlated oxide NdNiO3 journal October 2019
Dictionary learning in Fourier-transform scanning tunneling spectroscopy journal February 2020
Femtosecond exciton dynamics in WSe2 optical waveguides journal July 2020
Moiré metrology of energy landscapes in van der Waals heterostructures journal January 2021
Adaptive tip-enhanced nano-spectroscopy journal June 2021
Correlator convolutional neural networks as an interpretable architecture for image-like quantum matter data journal June 2021
Gate-tunable plasmons in mixed-dimensional van der Waals heterostructures journal August 2021
Nanoscale lattice dynamics in hexagonal boron nitride moiré superlattices journal September 2021
Deep neural networks for understanding noisy data applied to physical property extraction in scanning probe microscopy journal February 2019
Imaging mechanism for hyperspectral scanning probe microscopy via Gaussian process modelling journal March 2020
Ensemble learning-iterative training machine learning for uncertainty quantification and automated experiment in atom-resolved microscopy journal July 2021
Nano-imaging of strain-tuned stripe textures in a Mott crystal journal May 2021
Multi-messenger nanoprobes of hidden magnetism in a strained manganite journal December 2019
Towards data-driven next-generation transmission electron microscopy journal October 2020
Broad spectral tuning of ultra-low-loss polaritons in a van der Waals crystal by intercalation journal April 2020
Configurable phonon polaritons in twisted α-MoO3 journal July 2020
Radiative control of dark excitons at room temperature by nano-optical antenna-tip Purcell effect journal November 2017
Single-molecule resonance Raman effect in a plasmonic nanocavity journal January 2020
Visualization of moiré superlattices journal June 2020
Sub-nanometre resolution in single-molecule photoluminescence imaging journal August 2020
Deep learning for the design of photonic structures journal October 2020
Coexisting first- and second-order electronic phase transitions in a correlated oxide journal July 2018
Moiré engineering of electronic phenomena in correlated oxides journal April 2020
Deep moiré potentials in twisted transition metal dichalcogenide bilayers journal February 2021
Fundamental limits to graphene plasmonics journal May 2018
In-plane anisotropic and ultra-low-loss polaritons in a natural van der Waals crystal journal October 2018
Machine learning in electronic-quantum-matter imaging experiments journal June 2019
Origins of structural and electronic transitions in disordered silicon journal January 2021
Topological polaritons and photonic magic angles in twisted α-MoO3 bilayers journal June 2020
Efficient Fizeau drag from Dirac electrons in monolayer graphene journal June 2021
Interface nano-optics with van der Waals polaritons journal September 2021
Fizeau drag in graphene plasmonics journal June 2021
Deep learning enables cross-modality super-resolution in fluorescence microscopy journal December 2018
Differentiable biology: using deep learning for biophysics-based and data-driven modeling of molecular mechanisms journal October 2021
Computed terahertz near-field mapping of molecular resonances of lactose stereo-isomer impurities with sub-attomole sensitivity journal November 2019
Artificial-intelligence-driven scanning probe microscopy journal March 2020
Neural network-based order parameter for phase transitions and its applications in high-entropy alloys journal October 2021
High-resolution quantitative determination of dielectric function by using scattering scanning near-field optical microscopy journal July 2015
The TensorMol-0.1 model chemistry: a neural network augmented with long-range physics journal January 2018
An artificial intelligence atomic force microscope enabled by machine learning journal January 2018
Tip-enhanced Raman scattering journal January 2008
Pure optical contrast in scattering-type scanning near-field microscopy journal April 2001
Characterization of optically dense, doped semiconductors by reflection THz time domain spectroscopy journal June 1998
Origin of low dielectric constant of carbon-incorporated silicon oxide film deposited by plasma enhanced chemical vapor deposition journal September 2001
Generalized spectral method for near-field optical microscopy journal February 2016
Narrow-band near-field nanoscopy in the spectral range from 1.3 to 8.5 THz journal March 2016
Tutorial: An introduction to terahertz time domain spectroscopy (THz-TDS) journal December 2018
Scanning tunneling state recognition with multi-class neural network ensembles journal October 2019
Machine-learning-assisted metasurface design for high-efficiency thermal emitter optimization journal June 2020
Machine learning-based multidomain processing for texture-based image segmentation and analysis journal January 2020
The Raspberry Pi auto-aligner: Machine learning for automated alignment of laser beams journal January 2021
Optical constants from scattering-type scanning near-field optical microscope journal January 2021
Ultrabroadband infrared nanospectroscopic imaging journal May 2014
Machine learning for quantum matter journal January 2020
Artificial intelligence for photonics and photonic materials journal December 2020
Embedding human heuristics in machine-learning-enabled probe microscopy journal February 2020
Machine learning at the (sub)atomic scale: next generation scanning probe microscopy journal May 2020
Improving the segmentation of scanning probe microscope images using convolutional neural networks journal December 2020
SSNOMBACTER: A collection of scattering-type scanning near-field optical microscopy and atomic force microscopy images of bacterial cells journal November 2020
Microscopy Hacks: development of various techniques to assist quantitative nanoanalysis and advanced electron microscopy journal March 2013
Near-field microscopy by elastic light scattering from a tip
  • Keilmann, Fritz; Hillenbrand, Rainer
  • Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, Vol. 362, Issue 1817 https://doi.org/10.1098/rsta.2003.1347
journal April 2004
Visualizing strange metallic correlations in the two-dimensional Fermi-Hubbard model with artificial intelligence journal September 2020
Validity of Machine Learning in the Quantitative Analysis of Complex Scanning Near-Field Optical Microscopy Signals Using Simulated Data journal January 2021
Structural phase transitions in a MoWSe 2 monolayer: Molecular dynamics simulations and variational autoencoder analysis journal July 2019
Dynamics of electronically phase-separated states in the double exchange model journal March 2021
Phase diagram study of a two-dimensional frustrated antiferromagnet via unsupervised machine learning journal April 2021
Nanoscale chemical phase separation in FeTe 0.55 Se 0.45 as seen via scanning tunneling spectroscopy journal June 2011
Visualizing the charge density wave transition in 2 H - NbSe 2 in real space journal June 2014
Model for quantitative tip-enhanced spectroscopy and the extraction of nanoscale-resolved optical constants journal August 2014
Phase transition in bulk single crystals and thin films of V O 2 by nanoscale infrared spectroscopy and imaging journal June 2015
Discovering phase transitions with unsupervised learning journal November 2016
Dielectric properties of amorphous phase-change materials journal March 2017
Scattering of electromagnetic waves from a cone with conformal mapping: Application to scanning near-field optical microscope journal February 2018
Uncertainty-aware machine learning for high energy physics journal September 2021
Jet substructure classification in high-energy physics with deep neural networks journal May 2016
Jet flavor classification in high-energy physics with deep neural networks journal December 2016
Unsupervised learning of phase transitions: From principal component analysis to variational autoencoders journal August 2017
Physics-informed machine learning approach for reconstructing Reynolds stress modeling discrepancies based on DNS data journal March 2017
Electronic Phase Separation in the Slightly Underdoped Iron Pnictide Superconductor Ba 1 − x K x Fe 2 As 2 journal March 2009
Nanoscale Proximity Effect in the High-Temperature Superconductor Bi 2 Sr 2 CaCu 2 O 8 + δ Using a Scanning Tunneling Microscope journal March 2010
Long-Wavelength Local Density of States Oscillations Near Graphene Step Edges journal January 2012
KFe 2 Se 2 is the Parent Compound of K-Doped Iron Selenide Superconductors journal July 2012
Anisotropic Electronic State via Spontaneous Phase Separation in Strained Vanadium Dioxide Films journal August 2013
Quasiparticle Interference, Quasiparticle Interactions, and the Origin of the Charge Density Wave in 2 H − NbSe 2 journal January 2015
Random Field Driven Spatial Complexity at the Mott Transition in VO 2 journal January 2016
Discovering Physical Concepts with Neural Networks journal January 2020
Unsupervised Phase Discovery with Deep Anomaly Detection journal October 2020
Arrested Phase Separation in Double-Exchange Models: Large-Scale Simulation Enabled by Machine Learning journal September 2021
Classifying surface probe images in strongly correlated electronic systems via machine learning journal March 2019
Sparse sampling for fast quasiparticle-interference mapping journal May 2020
Machine learning holographic mapping by neural network renormalization group journal June 2020
Electrodynamics of high- T c superconductors journal August 2005
Electrodynamics of correlated electron materials journal June 2011
Machine learning and the physical sciences journal December 2019
Face recognition: a convolutional neural-network approach journal January 1997
Thermal Tuning of High-$T_{c}$ Superconducting Bi$_{2}$Sr $_{2}$CaCu$_{2}$ O$_{8+\delta }$ Terahertz Metamaterial journal October 2017
Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches journal April 2012
Multi-Fidelity Physics-Constrained Neural Network and Its Application in Materials Modeling journal September 2019
Electrodynamics of Solids: Optical Properties of Electrons in Matter journal December 2002
Nanophotonic particle simulation and inverse design using artificial neural networks journal June 2018
Transient exciton-polariton dynamics in WSe 2 by ultrafast near-field imaging journal February 2019
Ultrafast nonlocal collective dynamics of Kane plasmon-polaritons in a narrow-gap semiconductor journal August 2019
Tip-enhanced strong coupling spectroscopy, imaging, and control of a single quantum emitter journal July 2019
Automated structure discovery in atomic force microscopy journal February 2020
Ultrahigh-resolution scanning microwave impedance microscopy of moiré lattices and superstructures journal December 2020
Exploring order parameters and dynamic processes in disordered systems via variational autoencoders journal April 2021
Imaging Quasiparticle Interference in Bi2Sr2CaCu2O8+δ journal July 2002
Mott Transition in VO2 Revealed by Infrared Spectroscopy and Nano-Imaging journal December 2007
Tunable Phonon Polaritons in Atomically Thin van der Waals Crystals of Boron Nitride journal March 2014
Polaritons in van der Waals materials journal October 2016
Photonic crystals for nano-light in moiré graphene superlattices journal December 2018
Programmable hyperbolic polaritons in van der Waals semiconductors journal February 2021
Review of recent progress on THz spectroscopy of quantum materials: superconductors, magnetic and topological materials journal July 2021
Analytical model for quantitative prediction of material contrasts in scattering-type near-field optical microscopy journal January 2007
Substrate-enhanced infrared near-field spectroscopy journal January 2008
Quasi-analytical model for scattering infrared near-field microscopy on layered systems journal January 2012
Machine-learning techniques for fast and accurate feature localization in holograms of colloidal particles journal January 2018
Photo-induced terahertz near-field dynamics of graphene/InAs heterostructures journal January 2019
Hyperspectral time-domain terahertz nano-imaging journal January 2019
Deep learning for accelerated all-dielectric metasurface design journal January 2019
Machine learning approach for computing optical properties of a photonic crystal fiber journal January 2019
Physics-informed neural networks for inverse problems in nano-optics and metamaterials journal January 2020
Machine learning and evolutionary algorithm studies of graphene metamaterials for optimized plasmon-induced transparency journal January 2020
Mono-crystalline gold platelets: a high-quality platform for surface plasmon polaritons journal February 2020
Tip-enhanced photoluminescence nano-spectroscopy and nano-imaging journal May 2020
Polariton panorama journal November 2020
An Introduction to Variational Autoencoders journal January 2019
Detecting nematic order in STM/STS data with artificial intelligence journal June 2020
Variational Autoencoder Reconstruction of Complex Many-Body Physics journal November 2019
Basic Reinforcement Learning Techniques to Control the Intensity of a Seeded Free-Electron Laser journal May 2020
Complex Deep Learning with Quantum Optics journal July 2019

Similar Records

Bolometric Superconducting Optical Nanoscopy (BOSON)
Journal Article · Thu Jul 24 20:00:00 EDT 2025 · Physical Review. X · OSTI ID:3009085

Ultrasensitive Tip- and Antenna-Enhanced Infrared Nanoscopy of Protein Complexes
Journal Article · Thu Jul 18 00:00:00 EDT 2019 · Journal of Physical Chemistry C · OSTI ID:1571484

Magnetic field driven emergent phenomena: Insights from magneto-optics and nanoscopy
Journal Article · Thu Sep 11 20:00:00 EDT 2025 · Progress in Quantum Electronics · OSTI ID:2589351

Related Subjects