Deep data analysis via physically constrained linear unmixing: universal framework, domain examples, and a community-wide platform
Abstract
Abstract Many spectral responses in materials science, physics, and chemistry experiments can be characterized as resulting from the superposition of a number of more basic individual spectra. In this context, unmixing is defined as the problem of determining the individual spectra, given measurements of multiple spectra that are spatially resolved across samples, as well as the determination of the corresponding abundance maps indicating the local weighting of each individual spectrum. Matrix factorization is a popular linear unmixing technique that considers that the mixture model between the individual spectra and the spatial maps is linear. Here, we present a tutorial paper targeted at domain scientists to introduce linear unmixing techniques, to facilitate greater understanding of spectroscopic imaging data. We detail a matrix factorization framework that can incorporate different domain information through various parameters of the matrix factorization method. We demonstrate many domain-specific examples to explain the expressivity of the matrix factorization framework and show how the appropriate use of domain-specific constraints such as non-negativity and sum-to-one abundance result in physically meaningful spectral decompositions that are more readily interpretable. Our aim is not only to explain the off-the-shelf available tools, but to add additional constraints when ready-made algorithms are unavailable for themore »
- Authors:
- Publication Date:
- Research Org.:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Sponsoring Org.:
- USDOE Office of Science (SC), Basic Energy Sciences (BES); USDOE Office of Science (SC), Basic Energy Sciences (BES) (SC-22). Materials Sciences & Engineering Division
- OSTI Identifier:
- 1435364
- Alternate Identifier(s):
- OSTI ID: 1474632
- Grant/Contract Number:
- AC05-00OR22725
- Resource Type:
- Published Article
- Journal Name:
- Advanced Structural and Chemical Imaging
- Additional Journal Information:
- Journal Name: Advanced Structural and Chemical Imaging Journal Volume: 4 Journal Issue: 1; Journal ID: ISSN 2198-0926
- Publisher:
- Springer Science + Business Media
- Country of Publication:
- Germany
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; 47 OTHER INSTRUMENTATION; Unmixing; Image segmentation; Scanning probe microscopy; Matrix factorization; Big data; High performance
Citation Formats
Kannan, R., Ievlev, A. V., Laanait, N., Ziatdinov, M. A., Vasudevan, R. K., Jesse, S., and Kalinin, S. V. Deep data analysis via physically constrained linear unmixing: universal framework, domain examples, and a community-wide platform. Germany: N. p., 2018.
Web. doi:10.1186/s40679-018-0055-8.
Kannan, R., Ievlev, A. V., Laanait, N., Ziatdinov, M. A., Vasudevan, R. K., Jesse, S., & Kalinin, S. V. Deep data analysis via physically constrained linear unmixing: universal framework, domain examples, and a community-wide platform. Germany. https://doi.org/10.1186/s40679-018-0055-8
Kannan, R., Ievlev, A. V., Laanait, N., Ziatdinov, M. A., Vasudevan, R. K., Jesse, S., and Kalinin, S. V. Mon .
"Deep data analysis via physically constrained linear unmixing: universal framework, domain examples, and a community-wide platform". Germany. https://doi.org/10.1186/s40679-018-0055-8.
@article{osti_1435364,
title = {Deep data analysis via physically constrained linear unmixing: universal framework, domain examples, and a community-wide platform},
author = {Kannan, R. and Ievlev, A. V. and Laanait, N. and Ziatdinov, M. A. and Vasudevan, R. K. and Jesse, S. and Kalinin, S. V.},
abstractNote = {Abstract Many spectral responses in materials science, physics, and chemistry experiments can be characterized as resulting from the superposition of a number of more basic individual spectra. In this context, unmixing is defined as the problem of determining the individual spectra, given measurements of multiple spectra that are spatially resolved across samples, as well as the determination of the corresponding abundance maps indicating the local weighting of each individual spectrum. Matrix factorization is a popular linear unmixing technique that considers that the mixture model between the individual spectra and the spatial maps is linear. Here, we present a tutorial paper targeted at domain scientists to introduce linear unmixing techniques, to facilitate greater understanding of spectroscopic imaging data. We detail a matrix factorization framework that can incorporate different domain information through various parameters of the matrix factorization method. We demonstrate many domain-specific examples to explain the expressivity of the matrix factorization framework and show how the appropriate use of domain-specific constraints such as non-negativity and sum-to-one abundance result in physically meaningful spectral decompositions that are more readily interpretable. Our aim is not only to explain the off-the-shelf available tools, but to add additional constraints when ready-made algorithms are unavailable for the task. All examples use the scalable open source implementation from https://github.com/ramkikannan/nmflibrary that can run from small laptops to supercomputers, creating a user-wide platform for rapid dissemination and adoption across scientific disciplines.},
doi = {10.1186/s40679-018-0055-8},
journal = {Advanced Structural and Chemical Imaging},
number = 1,
volume = 4,
place = {Germany},
year = {Mon Apr 30 00:00:00 EDT 2018},
month = {Mon Apr 30 00:00:00 EDT 2018}
}
https://doi.org/10.1186/s40679-018-0055-8
Works referenced in this record:
Dynamic piezoresponse force microscopy: Spatially resolved probing of polarization dynamics in time and voltage domains
journal, September 2012
- Kumar, A.; Ehara, Y.; Wada, A.
- Journal of Applied Physics, Vol. 112, Issue 5
Microscopy: Hasten high resolution
journal, November 2014
- Pennycook, Stephen J.; Kalinin, Sergei V.
- Nature, Vol. 515, Issue 7528
STEM-EELS imaging of complex oxides and interfaces
journal, January 2012
- Varela, Maria; Gazquez, Jaume; Pennycook, Stephen J.
- MRS Bulletin, Vol. 37, Issue 01, p. 29-35
Multivariate statistical methods for the analysis of microscope image series: applications in materials science
journal, April 1998
- Bonnet, N.
- Journal of Microscopy, Vol. 190, Issue 1‐2
Principal component and spatial correlation analysis of spectroscopic-imaging data in scanning probe microscopy
journal, February 2009
- Jesse, Stephen; Kalinin, Sergei V.
- Nanotechnology, Vol. 20, Issue 8
‘All models are wrong...’: an introduction to model uncertainty
journal, July 2012
- Wit, Ernst; Heuvel, Edwin van den; Romeijn, Jan-Willem
- Statistica Neerlandica, Vol. 66, Issue 3
Exact matrix completion via convex optimization
journal, June 2012
- Candès, Emmanuel; Recht, Benjamin
- Communications of the ACM, Vol. 55, Issue 6
Quantitative 3D-KPFM imaging with simultaneous electrostatic force and force gradient detection
journal, April 2015
- Collins, L.; Okatan, M. B.; Li, Q.
- Nanotechnology, Vol. 26, Issue 17
LIII. On lines and planes of closest fit to systems of points in space
journal, November 1901
- Pearson, Karl
- The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science, Vol. 2, Issue 11
Direct Mapping of Ion Diffusion Times on LiCoO2 Surfaces with Nanometer Resolution
journal, January 2011
- Guo, S.; Jesse, S.; Kalnaus, S.
- Journal of The Electrochemical Society, Vol. 158, Issue 8
MPI-FAUN: An MPI-Based Framework for Alternating-Updating Nonnegative Matrix Factorization
journal, March 2018
- Kannan, Ramakrishnan; Ballard, Grey; Park, Haesun
- IEEE Transactions on Knowledge and Data Engineering, Vol. 30, Issue 3
Direct evidence of mesoscopic dynamic heterogeneities at the surfaces of ergodic ferroelectric relaxors
journal, February 2010
- Kalinin, S. V.; Rodriguez, B. J.; Budai, J. D.
- Physical Review B, Vol. 81, Issue 6
Matrix Factorization for Automatic Chemical Mapping from Electron Microscopic Spectral Imaging Datasets
journal, January 2016
- Shiga, Motoki; Muto, Shunsuke; Tatsumi, Kazuyoshi
- Transactions of the Materials Research Society of Japan, Vol. 41, Issue 4
Full-field X-ray reflection microscopy of epitaxial thin-films
journal, October 2014
- Laanait, Nouamane; Zhang, Zhan; Schlepütz, Christian M.
- Journal of Synchrotron Radiation, Vol. 21, Issue 6
Document clustering based on non-negative matrix factorization
conference, January 2003
- Xu, Wei; Liu, Xin; Gong, Yihong
- Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval - SIGIR '03
Hyperspectral coherent Raman imaging - principle, theory, instrumentation, and applications to life sciences: Hyperspectral coherent Raman imaging
journal, December 2015
- Kano, Hideaki; Segawa, Hiroki; Okuno, Masanari
- Journal of Raman Spectroscopy, Vol. 47, Issue 1
Hyperspectral surface-enhanced Raman imaging of labeled silver nanoparticles in single cells
journal, June 2005
- Wabuyele, Musundi B.; Yan, Fei; Griffin, Guy D.
- Review of Scientific Instruments, Vol. 76, Issue 6
Structure, physical properties, and applications of thin films
journal, March 2012
- Koster, Gertjan; Klein, Lior; Siemons, Wolter
- Reviews of Modern Physics, Vol. 84, Issue 1
TEM and EELS measurements of interface roughness in epitaxial Fe/MgO/Fe magnetic tunnel junctions
journal, April 2009
- Serin, V.; Andrieu, S.; Serra, R.
- Physical Review B, Vol. 79, Issue 14
Disorder Identification in Hysteresis Data: Recognition Analysis of the Random-Bond–Random-Field Ising Model
journal, October 2009
- Ovchinnikov, O. S.; Jesse, S.; Bintacchit, P.
- Physical Review Letters, Vol. 103, Issue 15
Chemical State Evolution in Ferroelectric Films during Tip-Induced Polarization and Electroresistive Switching
journal, October 2016
- Ievlev, Anton V.; Maksymovych, Petro; Trassin, Morgan
- ACS Applied Materials & Interfaces, Vol. 8, Issue 43
Joint Bayesian Endmember Extraction and Linear Unmixing for Hyperspectral Imagery
journal, November 2009
- Dobigeon, N.; Moussaoui, S.; Coulon, M.
- IEEE Transactions on Signal Processing, Vol. 57, Issue 11
VisIRR: Visual analytics for information retrieval and recommendation with large-scale document data
conference, October 2014
- Choo, Jaegul; Lee, Changhyun; Kim, Hannah
- 2014 IEEE Conference on Visual Analytics Science and Technology (VAST)
Spectral unmixing
journal, January 2002
- Keshava, N.; Mustard, J. F.
- IEEE Signal Processing Magazine, Vol. 19, Issue 1
Imaging nanoscale lattice variations by machine learning of x-ray diffraction microscopy data
journal, August 2016
- Laanait, Nouamane; Zhang, Zhan; Schlepütz, Christian M.
- Nanotechnology, Vol. 27, Issue 37
Electronic Properties of Isosymmetric Phase Boundaries in Highly Strained Ca-Doped BiFeO 3
journal, April 2014
- Seidel, Jan; Trassin, Morgan; Zhang, Yi
- Advanced Materials, Vol. 26, Issue 25
Learning the parts of objects by non-negative matrix factorization
journal, October 1999
- Lee, Daniel D.; Seung, H. Sebastian
- Nature, Vol. 401, Issue 6755
Better Catalysts through Microscopy: Mesoscale M1/M2 Intergrowth in Molybdenum–Vanadium Based Complex Oxide Catalysts for Propane Ammoxidation
journal, February 2015
- He, Qian; Woo, Jungwon; Belianinov, Alexei
- ACS Nano, Vol. 9, Issue 4
Memory Efficient Principal Component Analysis for the Dimensionality Reduction of Large Mass Spectrometry Imaging Data Sets
journal, March 2013
- Race, Alan M.; Steven, Rory T.; Palmer, Andrew D.
- Analytical Chemistry, Vol. 85, Issue 6
Spatial distribution of relaxation behavior on the surface of a ferroelectric relaxor in the ergodic phase
journal, October 2009
- Kalinin, S. V.; Rodriguez, B. J.; Jesse, S.
- Applied Physics Letters, Vol. 95, Issue 14
Principal Component Analysis of TOF-SIMS Images of Organic Monolayers
journal, November 2002
- Biesinger, Mark C.; Paepegaey, Pierre-Yves; McIntyre, N. Stewart
- Analytical Chemistry, Vol. 74, Issue 22
Fast rank-2 nonnegative matrix factorization for hierarchical document clustering
conference, January 2013
- Kuang, Da; Park, Haesun
- Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '13
Automated Interpretation and Extraction of Topographic Information from Time of Flight Secondary Ion Mass Spectrometry Data
journal, December 2017
- Ievlev, Anton V.; Belianinov, Alexei; Jesse, Stephen
- Scientific Reports, Vol. 7, Issue 1
Matrix Factorization Techniques for Recommender Systems
journal, August 2009
- Koren, Yehuda; Bell, Robert; Volinsky, Chris
- Computer, Vol. 42, Issue 8
Nanoscale Hard X-Ray Microscopy Methods for Materials Studies
journal, July 2013
- Holt, Martin; Harder, Ross; Winarski, Robert
- Annual Review of Materials Research, Vol. 43, Issue 1
Imaging Local Polarization in Ferroelectric Thin Films by Coherent X-Ray Bragg Projection Ptychography
journal, April 2013
- Hruszkewycz, S. O.; Highland, M. J.; Holt, M. V.
- Physical Review Letters, Vol. 110, Issue 17, Article No. 177601
Algorithms for nonnegative matrix and tensor factorizations: a unified view based on block coordinate descent framework
journal, March 2013
- Kim, Jingu; He, Yunlong; Park, Haesun
- Journal of Global Optimization, Vol. 58, Issue 2
Hyperopt: A Python Library for Optimizing the Hyperparameters of Machine Learning Algorithms
conference, January 2013
- Bergstra, James; Yamins, Dan; Cox, David
- Proceedings of the Python in Science Conference
Numerical Methods for Least Squares Problems
book, January 1996
- Björck, Åke
- Society for Industrial and Applied Mathematics
Sparse modeling of EELS and EDX spectral imaging data by nonnegative matrix factorization
journal, November 2016
- Shiga, Motoki; Tatsumi, Kazuyoshi; Muto, Shunsuke
- Ultramicroscopy, Vol. 170
Atomic-resolution spectroscopic imaging: past, present and future
journal, January 2009
- Pennycook, S. J.; Varela, M.; Lupini, A. R.
- Journal of Electron Microscopy, Vol. 58, Issue 3
X-ray micro-beam characterization of lattice rotations and distortions due to an individual dislocation
journal, November 2013
- Hofmann, Felix; Abbey, Brian; Liu, Wenjun
- Nature Communications, Vol. 4, Issue 1
Spatial resolution, information limit, and contrast transfer in piezoresponse force microscopy
journal, June 2006
- Kalinin, S. V.; Jesse, S.; Rodriguez, B. J.
- Nanotechnology, Vol. 17, Issue 14
Near-Field Hyperspectral Optical Imaging
journal, February 2014
- Bouillard, Jean-Sebastien G.; Dickson, Wayne; Wurtz, Gregory A.
- ChemPhysChem, Vol. 15, Issue 4
Effect of molybdenum hole substitution in BaFe As
journal, January 2012
- Sefat, Athena S.; Marty, Karol; Christianson, Andrew D.
- Physical Review B, Vol. 85, Issue 2
Phases and Interfaces from Real Space Atomically Resolved Data: Physics-Based Deep Data Image Analysis
journal, August 2016
- Vasudevan, Rama K.; Ziatdinov, Maxim; Jesse, Stephen
- Nano Letters, Vol. 16, Issue 9
Data mining graphene: correlative analysis of structure and electronic degrees of freedom in graphenic monolayers with defects
journal, November 2016
- Ziatdinov, Maxim; Fujii, Shintaro; Kiguchi, Manabu
- Nanotechnology, Vol. 27, Issue 49
Imaging with Mass Spectrometry
journal, October 1999
- Pacholski, M. L.; Winograd, N.
- Chemical Reviews, Vol. 99, Issue 10
Direct Determination of the Chemical Bonding of Individual Impurities in Graphene
journal, November 2012
- Zhou, Wu; Kapetanakis, Myron D.; Prange, Micah P.
- Physical Review Letters, Vol. 109, Issue 20
Imaging mass spectrometry
journal, January 2007
- McDonnell, Liam A.; Heeren, Ron M. A.
- Mass Spectrometry Reviews, Vol. 26, Issue 4
Graph Regularized Nonnegative Matrix Factorization for Data Representation
journal, August 2011
- Deng Cai,
- IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 33, Issue 8
Deep data mining in a real space: separation of intertwined electronic responses in a lightly doped BaFe 2 As 2
journal, October 2016
- Ziatdinov, Maxim; Maksov, Artem; Li, Li
- Nanotechnology, Vol. 27, Issue 47
Mapping chemical and bonding information using multivariate analysis of electron energy-loss spectrum images
journal, October 2006
- Bosman, M.; Watanabe, M.; Alexander, D. T. L.
- Ultramicroscopy, Vol. 106, Issue 11-12, p. 1024-1032
Bounded matrix factorization for recommender system
journal, December 2013
- Kannan, Ramakrishnan; Ishteva, Mariya; Park, Haesun
- Knowledge and Information Systems, Vol. 39, Issue 3
Hyperspectral Imaging with Stimulated Raman Scattering by Chirped Femtosecond Lasers
journal, November 2012
- Fu, Dan; Holtom, Gary; Freudiger, Christian
- The Journal of Physical Chemistry B, Vol. 117, Issue 16
Three-dimensional X-ray structural microscopy with submicrometre resolution
journal, February 2002
- Larson, B. C.; Yang, Wenge; Ice, G. E.
- Nature, Vol. 415, p. 887-890
Direct Mapping of Ionic Transport in a Si Anode on the Nanoscale: Time Domain Electrochemical Strain Spectroscopy Study
journal, November 2011
- Jesse, Stephen; Balke, Nina; Eliseev, Eugene
- ACS Nano, Vol. 5, Issue 12
Spatially Inhomogeneous Metal-Insulator Transition in Doped Manganites
journal, September 1999
- Fäth, M.
- Science, Vol. 285, Issue 5433
Full data acquisition in Kelvin Probe Force Microscopy: Mapping dynamic electric phenomena in real space
journal, August 2016
- Collins, Liam; Belianinov, Alex; Somnath, Suhas
- Scientific Reports, Vol. 6, Issue 1
Misfit strain relaxation by dislocations in SrRuO3/SrTiO3 (001) heteroepitaxy
journal, May 2004
- Oh, Sang Ho; Park, Chan Gyung
- Journal of Applied Physics, Vol. 95, Issue 9
Atom-by-atom spectroscopy at graphene edge
journal, December 2010
- Suenaga, Kazu; Koshino, Masanori
- Nature, Vol. 468, Issue 7327
Reconstruction of surface potential from Kelvin probe force microscopy images
journal, June 2013
- Cohen, G.; Halpern, E.; Nanayakkara, S. U.
- Nanotechnology, Vol. 24, Issue 29
The Race to X-ray Microbeam and Nanobeam Science
journal, December 2011
- Ice, G. E.; Budai, J. D.; Pang, J. W. L.
- Science, Vol. 334, Issue 6060
On the Equivalence of Nonnegative Matrix Factorization and Spectral Clustering
conference, January 2014
- Ding, Chris; He, Xiaofeng; Simon, Horst D.
- Proceedings of the 2005 SIAM International Conference on Data Mining
3D Chemical Image using TOF-SIMS Revealing the Biopolymer Component Spatial and Lateral Distributions in Biomass
journal, October 2012
- Jung, Seokwon; Foston, Marcus; Kalluri, Udaya C.
- Angewandte Chemie International Edition, Vol. 51, Issue 48
Hyperspectral optical imaging of human iris in vivo: characteristics of reflectance spectra
journal, January 2011
- Medina, José M.; Pereira, Luís M.; Correia, Hélder T.
- Journal of Biomedical Optics, Vol. 16, Issue 7
Li-ion dynamics and reactivity on the nanoscale
journal, November 2011
- Kalinin, Sergei; Balke, Nina; Jesse, Stephen
- Materials Today, Vol. 14, Issue 11