skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Big Data and Deep data in scanning and electron microscopies: functionality from multidimensional data sets

Journal Article · · Advanced Structural and Chemical Imaging

The development of electron, and scanning probe microscopies in the second half of the twentieth century have produced spectacular images of internal structure and composition of matter with, at nanometer, molecular, and atomic resolution. Largely, this progress was enabled by computer-assisted methods of microscope operation, data acquisition and analysis. The progress in imaging technologies in the beginning of the twenty first century has opened the proverbial floodgates of high-veracity information on structure and functionality. High resolution imaging now allows information on atomic positions with picometer precision, allowing for quantitative measurements of individual bond length and angles. Functional imaging often leads to multidimensional data sets containing partial or full information on properties of interest, acquired as a function of multiple parameters (time, temperature, or other external stimuli). Here, we review several recent applications of the big and deep data analysis methods to visualize, compress, and translate this data into physically and chemically relevant information from imaging data.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Center for Nanophase Materials Sciences (CNMS)
Sponsoring Organization:
USDOE Office of Science (SC)
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
1214489
Journal Information:
Advanced Structural and Chemical Imaging, Vol. 1, Issue 6; ISSN 2198-0926
Publisher:
SpringerCopyright Statement
Country of Publication:
United States
Language:
English

References (139)

A simple, combinatorial algorithm for solving SDD systems in nearly-linear time conference January 2013
Improved Nanotopography Sensing via Temperature Control of a Heated Atomic Force Microscope Cantilever journal November 2011
Chemistry and electronic structure of iron-based superconductors journal August 2011
Current imaging tunneling spectroscopy of metallic deposits on silicon journal July 1992
Spatially resolved mapping of disorder type and distribution in random systems using artificial neural network recognition journal July 2011
Local probing of relaxation time distributions in ferroelectric polymer nanomesas: Time-resolved piezoresponse force spectroscopy and spectroscopic imaging journal June 2008
Distilling Free-Form Natural Laws from Experimental Data journal April 2009
Nanoscale Control of Phase Variants in Strain-Engineered BiFeO 3 journal August 2011
Parameter Space Compression Underlies Emergent Theories and Predictive Models journal October 2013
Nano-chemistry and scanning probe nanolithographies journal January 2006
Bayes' Theorem in the 21st Century journal June 2013
Direct Mapping of Ion Diffusion Times on LiCoO2 Surfaces with Nanometer Resolution journal January 2011
7 × 7 Reconstruction on Si(111) Resolved in Real Space journal January 1983
Direct evidence of mesoscopic dynamic heterogeneities at the surfaces of ergodic ferroelectric relaxors journal February 2010
Unraveling Deterministic Mesoscopic Polarization Switching Mechanisms: Spatially Resolved Studies of a Tilt Grain Boundary in Bismuth Ferrite journal July 2009
Collective dynamics underpins Rayleigh behavior in disordered polycrystalline ferroelectrics journal April 2010
Watching domains grow: In-situ studies of polarization switching by combined scanning probe and scanning transmission electron microscopy journal September 2011
Complete information acquisition in dynamic force microscopy journal March 2015
Controlled mechnical modification of manganite surface with nanoscale resolution journal November 2014
Effect of Doping on Surface Reactivity and Conduction Mechanism in Samarium-Doped Ceria Thin Films journal November 2014
Current understanding and applications of the RHEED intensity oscillation technique journal February 1987
Mapping piezoelectric nonlinearity in the Rayleigh regime using band excitation piezoresponse force microscopy journal May 2011
Joint Bayesian Endmember Extraction and Linear Unmixing for Hyperspectral Imagery journal November 2009
Theory of orientational glasses models, concepts, simulations journal December 1992
Real Space Mapping of Li-Ion Transport in Amorphous Si Anodes with Nanometer Resolution journal September 2010
Collective dynamics in nanostructured polycrystalline ferroelectric thin films using local time-resolved measurements and switching spectroscopy journal January 2010
Local Electrochemical Functionality in Energy Storage Materials and Devices by Scanning Probe Microscopies: Status and Perspectives journal August 2010
Active centers, catalytic behavior, symbiosis and redox properties of MoV(Nb,Ta)TeO ammoxidation catalysts journal July 2006
Scanning force microscopy of domain structure in ferroelectric thin films: imaging and control journal September 1997
Domain Dynamics During Ferroelectric Switching journal November 2011
Nanoscale mapping of ion diffusion in a lithium-ion battery cathode journal August 2010
Double-Layer Mediated Electromechanical Response of Amyloid Fibrils in Liquid Environment journal January 2010
Quantifying the early stages of plasticity through nanoscale experiments and simulations journal March 2003
Instrumental Community: Probe Microscopy and the Path to Nanotechnology book January 2011
The band excitation method in scanning probe microscopy for rapid mapping of energy dissipation on the nanoscale journal September 2007
Spatially resolved probing of Preisach density in polycrystalline ferroelectric thin films journal October 2010
Artificial intelligence and pattern recognition techniques in microscope image processing and analysis book January 2000
A Preisach model with a temperature and time-dependent remanence maximum journal April 1997
Angular brushing of extended parallel coordinates conference January 2002
Picometre-precision analysis of scanning transmission electron microscopy images of platinum nanocatalysts journal June 2014
Learning Deep Architectures for AI journal January 2009
Large field-induced strains in a lead-free piezoelectric material journal January 2011
Factors Governing Oxygen Reduction in Solid Oxide Fuel Cell Cathodes journal October 2004
Resolution theory, and static and frequency-dependent cross-talk in piezoresponse force microscopy journal September 2010
Resonance enhancement in piezoresponse force microscopy: Mapping electromechanical activity, contact stiffness, and Q factor journal July 2006
Deep Data Analysis of Conductive Phenomena on Complex Oxide Interfaces: Physics from Data Mining journal May 2014
Ferroelastic domain wall dynamics in ferroelectric bilayers journal September 2010
Probing Local and Global Ferroelectric Phase Stability and Polarization Switching in Ordered Macroporous PZT journal February 2011
Diffuse phase transitions and random-field-induced domain states of the ‘‘relaxor’’ ferroelectric PbMg 1 / 3 Nb 2 / 3 O 3 journal February 1992
Spin glasses: Experimental facts, theoretical concepts, and open questions journal October 1986
Differentiating 180° and 90° switching of ferroelectric domains with three-dimensional piezoresponse force microscopy journal November 2000
Big data in reciprocal space: Sliding fast Fourier transforms for determining periodicity journal March 2015
Generalized Preisach model of hysteresis journal January 1988
Subspace clustering for high dimensional data: a review journal June 2004
Electromechanical Imaging and Spectroscopy of Ferroelectric and Piezoelectric Materials: State of the Art and Prospects for the Future journal August 2009
Information foraging. journal October 1999
Searching for exotic particles in high-energy physics with deep learning journal July 2014
Quantitative mapping of switching behavior in piezoresponse force microscopy journal July 2006
Real space mapping of polarization dynamics and hysteresis loop formation in relaxor-ferroelectric PbMg1/3Nb2/3O3–PbTiO3 solid solutions journal August 2010
Separation of Non-Negative Mixture of Non-Negative Sources Using a Bayesian Approach and MCMC Sampling journal November 2006
Scanning Force Microscopy Studies of Domain Structure in B a T i O 3 Single Crystals journal April 1997
Riemannian Manifold Learning journal May 2008
Spatially Resolved Spectroscopic Mapping of Polarization Reversal in Polycrystalline Ferroelectric Films: Crossing the Resolution Barrier journal July 2009
Switching spectroscopy piezoresponse force microscopy of polycrystalline capacitor structures journal January 2009
Ionic field effect and memristive phenomena in single-point ferroelectric domain switching journal July 2014
Defect-induced asymmetry of local hysteresis loops on BiFeO3 surfaces journal October 2009
Nonlinear Phenomena in Multiferroic Nanocapacitors: Joule Heating and Electromechanical Effects journal October 2011
Multivariate statistical methods for the analysis of microscope image series: applications in materials science journal April 1998
Research Update: Spatially resolved mapping of electronic structure on atomic level by multivariate statistical analysis journal December 2014
Mapping bias-induced phase stability and random fields in relaxor ferroelectrics journal August 2009
Principal component and spatial correlation analysis of spectroscopic-imaging data in scanning probe microscopy journal February 2009
Composition and phase dependence of the intrinsic and extrinsic piezoelectric activity of domain engineered (1−x)Pb(Mg1/3Nb2/3)O3−xPbTiO3 crystals journal August 2010
A Global Geometric Framework for Nonlinear Dimensionality Reduction journal December 2000
Mapping internal structure of coal by confocal micro-Raman spectroscopy and scanning microwave microscopy journal June 2014
Local bias-induced phase transitions journal November 2008
Piezoelectric response of nanoscale PbTiO3 in composite PbTiO3−CoFe2O4 epitaxial films journal August 2008
Mechanically-Induced Resistive Switching in Ferroelectric Tunnel Junctions journal February 2012
Insertion Electrode Materials for Rechargeable Lithium Batteries journal July 1998
Atomic force microscope cantilevers for combined thermomechanical data writing and reading journal February 2001
Local thermomechanical characterization of phase transitions using band excitation atomic force acoustic microscopy with heated probe journal August 2008
A visual analytics agenda journal January 2006
Measuring oxygen reduction/evolution reactions on the nanoscale journal August 2011
Dual-frequency resonance-tracking atomic force microscopy journal October 2007
Nanometer-scale flow of molten polyethylene from a heated atomic force microscope tip journal May 2012
Domain pinning near a single-grain boundary in tetragonal and rhombohedral lead zirconate titanate films journal April 2015
Mapping Irreversible Electrochemical Processes on the Nanoscale: Ionic Phenomena in Li Ion Conductive Glass Ceramics journal October 2011
Silicon Nanowire Transistors with a Channel Width of 4 nm Fabricated by Atomic Force Microscope Nanolithography journal November 2008
Local measurements of Preisach density in polycrystalline ferroelectric capacitors using piezoresponse force spectroscopy journal March 2010
Correlative Multimodal Probing of Ionically-Mediated Electromechanical Phenomena in Simple Oxides journal October 2013
Disorder Identification in Hysteresis Data: Recognition Analysis of the Random-Bond–Random-Field Ising Model journal October 2009
Multidimensional Spectral Hashing book January 2012
Direct imaging of the spatial and energy distribution of nucleation centres in ferroelectric materials journal February 2008
Semi-Supervised Linear Spectral Unmixing Using a Hierarchical Bayesian Model for Hyperspectral Imagery journal July 2008
Extracting physics through deep data analysis journal November 2014
Probing Local Ionic Dynamics in Functional Oxides at the Nanoscale journal July 2013
Consequences of High Adatom Energy during Pulsed Laser Deposition of La 0.7 Sr 0.3 MnO 3 journal January 2012
Nonlinear Dimensionality Reduction by Locally Linear Embedding journal December 2000
Switching spectroscopy piezoresponse force microscopy of ferroelectric materials journal February 2006
The International Exascale Software Project roadmap journal January 2011
Spatial distribution of relaxation behavior on the surface of a ferroelectric relaxor in the ergodic phase journal October 2009
Functional recognition imaging using artificial neural networks: applications to rapid cellular identification via broadband electromechanical response journal September 2009
The plane with parallel coordinates journal August 1985
Temperature-dependent phase transitions in zeptoliter volumes of a complex biological membrane journal December 2010
Does freezing in PbMg1/3Nb2/3O3 relaxor manifest itself in nonlinear dielectric susceptibility? journal March 1999
Band excitation in scanning probe microscopy: sines of change journal November 2011
Real-space mapping of dynamic phenomena during hysteresis loop measurements: Dynamic switching spectroscopy piezoresponse force microscopy journal May 2011
Big data visual analytics for exploratory earth system simulation analysis journal December 2013
Mechanical Control of Electroresistive Switching journal August 2013
N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data conference October 1999
Laplacian Eigenmaps for Dimensionality Reduction and Data Representation journal June 2003
Guided analysis of hurricane trends using statistical processes integrated with interactive parallel coordinates conference October 2009
Local Conduction at the BiFeO3-CoFe2O4 Tubular Oxide Interface journal July 2012
Mapping chemical and bonding information using multivariate analysis of electron energy-loss spectrum images journal October 2006
Rapid multidimensional data acquisition in scanning probe microscopy applied to local polarization dynamics and voltage dependent contact mechanics journal September 2008
Computational modeling of the forward and reverse problems in instrumented sharp indentation journal November 2001
Band Excitation in Scanning Probe Microscopy: Recognition and Functional Imaging journal April 2014
Decoupling Electrochemical Reaction and Diffusion Processes in Ionically-Conductive Solids on the Nanometer Scale journal November 2010
The future lies in uncertainty journal July 2014
Scented Widgets: Improving Navigation Cues with Embedded Visualizations journal November 2007
Nanoscale ferroelectrics: processing, characterization and future trends journal July 2006
Morphology Mapping of Phase-Separated Polymer Films Using Nanothermal Analysis journal August 2010
Big-Data Reflection High Energy Electron Diffraction Analysis for Understanding Epitaxial Film Growth Processes journal October 2014
Recent developments in catalysis using nanostructured materials journal March 2009
Probing the temperature dependence of the mechanical properties of polymers at the nanoscale with band excitation thermal scanning probe microscopy journal September 2009
Robust non-linear dimensionality reduction using successive 1-dimensional Laplacian Eigenmaps conference January 2007
Bulk superconductivity at 14 K in single crystals of Fe 1 + y Te x Se 1 x journal March 2009
Spatially Resolved Mapping of Polarization Switching Behavior in Nanoscale Ferroelectrics journal January 2008
Machine learning identifies a strong association between warming and reduced primary productivity in an oligotrophic ocean gyre journal February 2020
Parallel Coordinates book April 2021
Parallel Coordinates book January 1991
Parallel Coordinates reference-book January 2016
Visual Analytics book January 2016
GX-Means: A model-based divide and merge algorithm for geospatial image clustering journal January 2011
Oscillation of the lattice relaxation in layer-by-layer epitaxial growth of highly strained materials journal August 1993
Blind Unmixing of Linear Mixtures using a Hierarchical Bayesian Model. Application to Spectroscopic Signal Analysis conference August 2007
Algorithm AS 136: A K-Means Clustering Algorithm journal January 1979
Joint Bayesian endmember extraction and linear unmixing for hyperspectral imagery text January 2009
Parameter Space Compression Underlies Emergent Theories and Predictive Models text January 2013
Increasing the Capability of Neural Networks for Surface Reconstruction from Noisy Point Clouds preprint January 2018

Cited By (27)

LiberTEM/LiberTEM: 0.5.1 software August 2020
LiberTEM/LiberTEM: 0.2.0 software October 2019
LiberTEM/LiberTEM: 0.3.0 software December 2019
LiberTEM/LiberTEM-blobfinder: 0.4.0 software February 2020
LiberTEM/LiberTEM: 0.4.0 software February 2020
LiberTEM/LiberTEM: 0.4.1 software February 2020
Identification of phases, symmetries and defects through local crystallography journal July 2015
Understanding and designing magnetoelectric heterostructures guided by computation: progresses, remaining questions, and perspectives journal May 2017
Automated defect analysis in electron microscopic images journal July 2018
Application of pan-sharpening algorithm for correlative multimodal imaging using AFM-IR journal April 2019
Machine learning-based multidomain processing for texture-based image segmentation and analysis journal January 2020
Multifrequency spectrum analysis using fully digital G Mode-Kelvin probe force microscopy journal February 2016
Decoding crystallography from high-resolution electron imaging and diffraction datasets with deep learning journal October 2019
LiberTEM/LiberTEM: 0.2.2 software October 2019
LiberTEM/LiberTEM-blobfinder: 0.4.0 software February 2020
Research Update: Towards designed functionalities in oxide-based electronic materials journal August 2015
Direct atomic fabrication and dopant positioning in Si using electron beams with active real-time image-based feedback journal April 2018
Adjustable general line coordinates for visual knowledge discovery in n-D data journal July 2017
LiberTEM/LiberTEM: 0.5.0 software April 2020
Machine Detection of Enhanced Electromechanical Energy Conversion in PbZr 0.2 Ti 0.8 O 3 Thin Films journal May 2018
Smart machine learning or discovering meaningful physical and chemical contributions through dimensional stacking journal August 2019
LiberTEM/LiberTEM: 0.2.1 software October 2019
Atomic-scale observation of structural and electronic orders in the layered compound α-RuCl3 journal December 2016
Theory-Guided Machine Learning in Materials Science journal June 2016
Machine learning application in the life time of materials preprint January 2017
Detecting Nematic Order in STM/STS Data with Artificial Intelligence text January 2019
Next-Generation Information Technology Systems for Fast Detectors in Electron Microscop text January 2020