DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Learning surface molecular structures via machine vision

Journal Article · · npj Computational Materials
 [1]; ORCiD logo [2];  [1]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
  2. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Univ. of Tennessee, Knoxville, TN (United States)

Recent advances in high resolution scanning transmission electron and scanning probe microscopies have allowed researchers to perform measurements of materials structural parameters and functional properties in real space with a picometre precision. In many technologically relevant atomic and/or molecular systems, however, the information of interest is distributed spatially in a non-uniform manner and may have a complex multi-dimensional nature. One of the critical issues, therefore, lies in being able to accurately identify (‘read out’) all the individual building blocks in different atomic/molecular architectures, as well as more complex patterns that these blocks may form, on a scale of hundreds and thousands of individual atomic/molecular units. Here we employ machine vision to read and recognize complex molecular assemblies on surfaces. Specifically, we combine Markov random field model and convolutional neural networks to classify structural and rotational states of all individual building blocks in molecular assembly on the metallic surface visualized in high-resolution scanning tunneling microscopy measurements. We show how the obtained full decoding of the system allows us to directly construct a pair density function—a centerpiece in analysis of disorder-property relationship paradigm—as well as to analyze spatial correlations between multiple order parameters at the nanoscale, and elucidate reaction pathway involving molecular conformation changes. Here, the method represents a significant shift in our way of analyzing atomic and/or molecular resolved microscopic images and can be applied to variety of other microscopic measurements of structural, electronic, and magnetic orders in different condensed matter systems.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
1376377
Journal Information:
npj Computational Materials, Journal Name: npj Computational Materials Journal Issue: 1 Vol. 3; ISSN 2057-3960
Publisher:
Nature Publishing GroupCopyright Statement
Country of Publication:
United States
Language:
English

References (37)

Ab initio quantum chemistry: Methodology and applications journal May 2005
A disorder-enhanced quasi-one-dimensional superconductor journal July 2016
Spontaneous Vortex Nanodomain Arrays at Ferroelectric Heterointerfaces journal February 2011
Markov Random Field Texture Models journal January 1983
Bowl Inversion and Electronic Switching of Buckybowls on Gold journal September 2016
Strain Doping: Reversible Single-Axis Control of a Complex Oxide Lattice via Helium Implantation journal June 2015
Local Indicators of Spatial Association-LISA journal April 1995
Charge transfer and screening in individual C 60 molecules on metal substrates: A scanning tunneling spectroscopy and theoretical study journal September 2004
Big–deep–smart data in imaging for guiding materials design journal September 2015
First-principles calculations for point defects in solids journal March 2014
Scanning tunneling microscopy fingerprints of point defects in graphene: A theoretical prediction journal September 2007
Mapping Octahedral Tilts and Polarization Across a Domain Wall in BiFeO 3 from Z-Contrast Scanning Transmission Electron Microscopy Image Atomic Column Shape Analysis journal October 2010
The manipulation of C 60 in molecular arrays with an STM tip in regimes below the decomposition threshold journal January 2013
A Synthesis of Sumanene, a Fullerene Fragment journal September 2003
Structure and energetics of the vacancy in graphite journal October 2003
Rigorous force field optimization principles based on statistical distance minimization journal October 2015
Strain Doping: Reversible Single-Axis Control of a Complex Oxide Lattice via Helium Implantation text January 2015
Bowl Inversion of Surface-Adsorbed Sumanene journal September 2014
Combining satellite imagery and machine learning to predict poverty journal August 2016
Principal component and spatial correlation analysis of spectroscopic-imaging data in scanning probe microscopy journal February 2009
Visualization of the Molecular Jahn-Teller Effect in an Insulating K4C60 Monolayer journal October 2005
Interplay between defects, disorder and flexibility in metal-organic frameworks journal December 2016
Direct observation of Σ7 domain boundary core structure in magnetic skyrmion lattice journal February 2016
First-Principles Calculations of Complex Metal-Oxide Materials journal August 2010
Unit-cell scale mapping of ferroelectricity and tetragonality in epitaxial ultrathin ferroelectric films journal December 2006
The crystallography of correlated disorder journal May 2015
Design of crystal-like aperiodic solids with selective disorder–phonon coupling journal February 2016
The Analysis of Spatial Association by Use of Distance Statistics journal July 1992
Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis journal May 2016
On the optimality of solutions of the max-product belief-propagation algorithm in arbitrary graphs journal January 2001
Direct Imaging of Covalent Bond Structure in Single-Molecule Chemical Reactions journal May 2013
Observing Atomic Collapse Resonances in Artificial Nuclei on Graphene journal March 2013
Atomic-scale study of electric dipoles near charged and uncharged domain walls in ferroelectric films journal December 2007
A disorder-enhanced quasi-one-dimensional superconductor text January 2016
Microscopy: Hasten high resolution journal November 2014
Defocused Emission Patterns from Chiral Fluorophores: Application to Chiral Axis Orientation Determination journal February 2011
Markov Random Fields for Vision and Image Processing book July 2011

Cited By (15)

Analyzing machine learning models to accelerate generation of fundamental materials insights journal March 2019
Revealing ferroelectric switching character using deep recurrent neural networks journal October 2019
Building and exploring libraries of atomic defects in graphene: Scanning transmission electron and scanning tunneling microscopy study journal September 2019
Simulation and design of energy materials accelerated by machine learning journal June 2019
AFLOW-ML: A RESTful API for machine-learning predictions of materials properties preprint January 2017
Building and exploring libraries of atomic defects in graphene: Scanning transmission electron and scanning tunneling microscopy study journal September 2019
Combining large-scale screening and machine learning to predict the metal-organic frameworks for organosulfurs removal from high-sour natural gas journal September 2019
Interface Characterization and Control of 2D Materials and Heterostructures journal July 2018
Automated structure discovery in atomic force microscopy journal February 2020
Machine learning for molecular and materials science journal July 2018
Atom-by-atom fabrication with electron beams journal June 2019
Materials science in the artificial intelligence age: high-throughput library generation, machine learning, and a pathway from correlations to the underpinning physics journal July 2019
Automated Structure Discovery in Atomic Force Microscopy text January 2019
Deep data analytics for genetic engineering of diatoms linking genotype to phenotype via machine learning journal June 2019
Building and exploring libraries of atomic defects in graphene: scanning transmission electron and scanning tunneling microscopy study preprint January 2018