Harnessing interpretable and unsupervised machine learning to address big data from modern X-ray diffraction
Abstract
The information content of crystalline materials becomes astronomical when collective electronic behavior and their fluctuations are taken into account. In the past decade, improvements in source brightness and detector technology at modern X-ray facilities have allowed a dramatically increased fraction of this information to be captured. Now, the primary challenge is to understand and discover scientific principles from big datasets when a comprehensive analysis is beyond human reach. We report the development of an unsupervised machine learning approach, X-ray diffraction (XRD) temperature clustering (X-TEC), that can automatically extract charge density wave order parameters and detect intraunit cell ordering and its fluctuations from a series of high-volume X-ray diffraction measurements taken at multiple temperatures. We benchmark X-TEC with diffraction data on a quasi-skutterudite family of materials, (Ca x Sr
- Authors:
-
- Cornell Univ., Ithaca, NY (United States)
- Argonne National Lab. (ANL), Lemont, IL (United States). Materials Science Division
- Univ. of Tennessee, Knoxville, TN (United States)
- Univ. of Maryland, College Park, MD (United States); National Inst. of Standards and Technology (NIST), Gaithersburg, MD (United States)
- New York Univ. (NYU), NY (United States)
- Argonne National Lab. (ANL), Lemont, IL (United States). Materials Science Division; Northern Illinois Univ., DeKalb, IL (United States)
- Publication Date:
- Research Org.:
- Argonne National Laboratory (ANL), Argonne, IL (United States); Cornell Univ., Ithaca, NY (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Basic Energy Sciences (BES). Materials Sciences & Engineering Division; National Science Foundation (NSF); USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities Division
- OSTI Identifier:
- 1905312
- Alternate Identifier(s):
- OSTI ID: 2322542
- Grant/Contract Number:
- AC02-06CH11357; SC0018946; OAC-1934714; DMR-1719875; DMR-1332208; DMR-1829070
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Proceedings of the National Academy of Sciences of the United States of America
- Additional Journal Information:
- Journal Volume: 119; Journal Issue: 24; Journal ID: ISSN 0027-8424
- Publisher:
- National Academy of Sciences
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 36 MATERIALS SCIENCE; X-ray scattering; big data; machine learning
Citation Formats
Venderley, Jordan, Mallayya, Krishnanand, Matty, Michael, Krogstad, Matthew, Ruff, Jacob, Pleiss, Geoff, Kishore, Varsha, Mandrus, David, Phelan, Daniel, Poudel, Lekhanath, Wilson, Andrew Gordon, Weinberger, Kilian, Upreti, Puspa, Norman, Michael, Rosenkranz, Stephan, Osborn, Raymond, and Kim, Eun-Ah. Harnessing interpretable and unsupervised machine learning to address big data from modern X-ray diffraction. United States: N. p., 2022.
Web. doi:10.1073/pnas.2109665119.
Venderley, Jordan, Mallayya, Krishnanand, Matty, Michael, Krogstad, Matthew, Ruff, Jacob, Pleiss, Geoff, Kishore, Varsha, Mandrus, David, Phelan, Daniel, Poudel, Lekhanath, Wilson, Andrew Gordon, Weinberger, Kilian, Upreti, Puspa, Norman, Michael, Rosenkranz, Stephan, Osborn, Raymond, & Kim, Eun-Ah. Harnessing interpretable and unsupervised machine learning to address big data from modern X-ray diffraction. United States. https://doi.org/10.1073/pnas.2109665119
Venderley, Jordan, Mallayya, Krishnanand, Matty, Michael, Krogstad, Matthew, Ruff, Jacob, Pleiss, Geoff, Kishore, Varsha, Mandrus, David, Phelan, Daniel, Poudel, Lekhanath, Wilson, Andrew Gordon, Weinberger, Kilian, Upreti, Puspa, Norman, Michael, Rosenkranz, Stephan, Osborn, Raymond, and Kim, Eun-Ah. Thu .
"Harnessing interpretable and unsupervised machine learning to address big data from modern X-ray diffraction". United States. https://doi.org/10.1073/pnas.2109665119. https://www.osti.gov/servlets/purl/1905312.
@article{osti_1905312,
title = {Harnessing interpretable and unsupervised machine learning to address big data from modern X-ray diffraction},
author = {Venderley, Jordan and Mallayya, Krishnanand and Matty, Michael and Krogstad, Matthew and Ruff, Jacob and Pleiss, Geoff and Kishore, Varsha and Mandrus, David and Phelan, Daniel and Poudel, Lekhanath and Wilson, Andrew Gordon and Weinberger, Kilian and Upreti, Puspa and Norman, Michael and Rosenkranz, Stephan and Osborn, Raymond and Kim, Eun-Ah},
abstractNote = {The information content of crystalline materials becomes astronomical when collective electronic behavior and their fluctuations are taken into account. In the past decade, improvements in source brightness and detector technology at modern X-ray facilities have allowed a dramatically increased fraction of this information to be captured. Now, the primary challenge is to understand and discover scientific principles from big datasets when a comprehensive analysis is beyond human reach. We report the development of an unsupervised machine learning approach, X-ray diffraction (XRD) temperature clustering (X-TEC), that can automatically extract charge density wave order parameters and detect intraunit cell ordering and its fluctuations from a series of high-volume X-ray diffraction measurements taken at multiple temperatures. We benchmark X-TEC with diffraction data on a quasi-skutterudite family of materials, (Ca x Sr 1 − x ) 3 Rh 4 Sn 13 , where a quantum critical point is observed as a function of Ca concentration. We apply X-TEC to XRD data on the pyrochlore metal, Cd 2 Re 2 O 7 , to investigate its two much-debated structural phase transitions and uncover the Goldstone mode accompanying them. We demonstrate how unprecedented atomic-scale knowledge can be gained when human researchers connect the X-TEC results to physical principles. Specifically, we extract from the X-TEC–revealed selection rules that the Cd and Re displacements are approximately equal in amplitude but out of phase. This discovery reveals a previously unknown involvement of 5 d 2 Re, supporting the idea of an electronic origin to the structural order. Our approach can radically transform XRD experiments by allowing in operando data analysis and enabling researchers to refine experiments by discovering interesting regions of phase space on the fly.},
doi = {10.1073/pnas.2109665119},
journal = {Proceedings of the National Academy of Sciences of the United States of America},
number = 24,
volume = 119,
place = {United States},
year = {Thu Jun 09 00:00:00 EDT 2022},
month = {Thu Jun 09 00:00:00 EDT 2022}
}
Works referenced in this record:
Spatially modulated 'Mottness' in La2-xBaxCuO4
journal, December 2005
- Abbamonte, P.; Rusydi, A.; Smadici, S.
- Nature Physics, Vol. 1, Issue 3
The microscopic structure of charge density waves in underdoped YBa2Cu3O6.54 revealed by X-ray diffraction
journal, December 2015
- Forgan, E. M.; Blackburn, E.; Holmes, A. T.
- Nature Communications, Vol. 6, Issue 1
Intra-unit-cell electronic nematicity of the high-Tc copper-oxide pseudogap states
journal, July 2010
- Lawler, M. J.; Fujita, K.; Lee, Jhinhwan
- Nature, Vol. 466, Issue 7304
Nematic Fermi Fluids in Condensed Matter Physics
journal, August 2010
- Fradkin, Eduardo; Kivelson, Steven A.; Lawler, Michael J.
- Annual Review of Condensed Matter Physics, Vol. 1, Issue 1
Intertwined Vestigial Order in Quantum Materials: Nematicity and Beyond
journal, March 2019
- Fernandes, Rafael M.; Orth, Peter P.; Schmalian, Jörg
- Annual Review of Condensed Matter Physics, Vol. 10, Issue 1
Parity-Breaking Phases of Spin-Orbit-Coupled Metals with Gyrotropic, Ferroelectric, and Multipolar Orders
journal, July 2015
- Fu, Liang
- Physical Review Letters, Vol. 115, Issue 2
A parity-breaking electronic nematic phase transition in the spin-orbit coupled metal Cd 2 Re 2 O 7
journal, April 2017
- Harter, J. W.; Zhao, Z. Y.; Yan, J. -Q.
- Science, Vol. 356, Issue 6335
Goldstone-Mode Phonon Dynamics in the Pyrochlore
journal, September 2005
- Kendziora, C. A.; Sergienko, I. A.; Jin, R.
- Physical Review Letters, Vol. 95, Issue 12
Machine learning in electronic-quantum-matter imaging experiments
journal, June 2019
- Zhang, Yi; Mesaros, A.; Fujita, K.
- Nature, Vol. 570, Issue 7762
Classifying snapshots of the doped Hubbard model with machine learning
journal, July 2019
- Bohrdt, Annabelle; Chiu, Christie S.; Ji, Geoffrey
- Nature Physics, Vol. 15, Issue 9
One-component order parameter in URu 2 Si 2 uncovered by resonant ultrasound spectroscopy and machine learning
journal, March 2020
- Ghosh, Sayak; Matty, Michael; Baumbach, Ryan
- Science Advances, Vol. 6, Issue 10
Integrating Neural Networks with a Quantum Simulator for State Reconstruction
journal, December 2019
- Torlai, Giacomo; Timar, Brian; van Nieuwenburg, Evert P. L.
- Physical Review Letters, Vol. 123, Issue 23
Detection of hidden structures for arbitrary scales in complex physical systems
journal, March 2012
- Ronhovde, P.; Chakrabarty, S.; Hu, D.
- Scientific Reports, Vol. 2, Issue 1
Imaging mechanism for hyperspectral scanning probe microscopy via Gaussian process modelling
journal, March 2020
- Ziatdinov, Maxim; Kim, Dohyung; Neumayer, Sabine
- npj Computational Materials, Vol. 6, Issue 1
Structural characterisation of amorphous solid dispersions via metropolis matrix factorisation of pair distribution function data
journal, January 2019
- Geddes, Harry S.; Blade, Helen; McCabe, James F.
- Chemical Communications, Vol. 55, Issue 89
Computer-assisted area detector masking
journal, January 2017
- Wright, Christopher J.; Zhou, Xiao-Dong
- Journal of Synchrotron Radiation, Vol. 24, Issue 2
Rapid identification of structural phases in combinatorial thin-film libraries using x-ray diffraction and non-negative matrix factorization
journal, October 2009
- Long, C. J.; Bunker, D.; Li, X.
- Review of Scientific Instruments, Vol. 80, Issue 10
Unsupervised phase mapping of X-ray diffraction data by nonnegative matrix factorization integrated with custom clustering
journal, August 2018
- Stanev, Valentin; Vesselinov, Velimir V.; Kusne, A. Gilad
- npj Computational Materials, Vol. 4, Issue 1
Machine learning on neutron and x-ray scattering and spectroscopies
journal, September 2021
- Chen, Zhantao; Andrejevic, Nina; Drucker, Nathan C.
- Chemical Physics Reviews, Vol. 2, Issue 3
Speaker Verification Using Adapted Gaussian Mixture Models
journal, January 2000
- Reynolds, Douglas A.; Quatieri, Thomas F.; Dunn, Robert B.
- Digital Signal Processing, Vol. 10, Issue 1-3
Ambient Pressure Structural Quantum Critical Point in the Phase Diagram of
journal, March 2015
- Goh, S. K.; Tompsett, D. A.; Saines, P. J.
- Physical Review Letters, Vol. 114, Issue 9
Online EM for unsupervised models
conference, January 2009
- Liang, Percy; Klein, Dan
- Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics on - NAACL '09
From quantum matter to high-temperature superconductivity in copper oxides
journal, February 2015
- Keimer, B.; Kivelson, S. A.; Norman, M. R.
- Nature, Vol. 518, Issue 7538
Evidence of a structural quantum critical point in ( Ca x Sr 1 − x ) 3 Rh 4 Sn 13 from a lattice dynamics study
journal, October 2018
- Cheung, Y. W.; Hu, Y. J.; Imai, M.
- Physical Review B, Vol. 98, Issue 16
Unveiling charge density wave quantum phase transitions by x-ray diffraction
journal, May 2020
- Carneiro, F. B.; Veiga, L. S. I.; Mardegan, J. R. L.
- Physical Review B, Vol. 101, Issue 19
Reciprocal space imaging of ionic correlations in intercalation compounds
journal, October 2019
- Krogstad, Matthew J.; Rosenkranz, Stephan; Wozniak, Justin M.
- Nature Materials, Vol. 19, Issue 1
Superconductivity in the correlated pyrochlore
journal, October 2001
- Jin, R.; He, J.; McCall, S.
- Physical Review B, Vol. 64, Issue 18
Superconductivity at 1 K in
journal, October 2001
- Hanawa, M.; Muraoka, Y.; Tayama, T.
- Physical Review Letters, Vol. 87, Issue 18
Superconductivity in a pyrochlore oxide, Cd 2 Re 2 O 7
journal, August 2001
- Sakai, Hironori; Yoshimura, Kazuyoshi; Ohno, Hiroyuki
- Journal of Physics: Condensed Matter, Vol. 13, Issue 33
Nonlinear optical signatures of the tensor order in Cd2Re2O7
journal, August 2006
- Petersen, Jesse C.; Caswell, Michael D.; Dodge, J. Steven
- Nature Physics, Vol. 2, Issue 9
Pyrochlore Oxide Superconductor Cd 2 Re 2 O 7 Revisited
journal, February 2018
- Hiroi, Zenji; Yamaura, Jun-ichi; Kobayashi, Tatsuo C.
- Journal of the Physical Society of Japan, Vol. 87, Issue 2
Nature of the tensor order in
journal, September 2017
- Di Matteo, S.; Norman, M. R.
- Physical Review B, Vol. 96, Issue 11
Electric Toroidal Quadrupoles in the Spin-Orbit-Coupled Metal Cd 2 Re 2 O 7
journal, April 2019
- Hayami, Satoru; Yanagi, Yuki; Kusunose, Hiroaki
- Physical Review Letters, Vol. 122, Issue 14
Evidence of an Improper Displacive Phase Transition in via Time-Resolved Coherent Phonon Spectroscopy
journal, January 2018
- Harter, J. W.; Kennes, D. M.; Chu, H.
- Physical Review Letters, Vol. 120, Issue 4
Discovery of a low-temperature orthorhombic phase of the
Cd 2 Re 2 O 7
superconductor
journal, July 2020
- Kapcia, Konrad J.; Reedyk, Maureen; Hajialamdari, Mojtaba
- Physical Review Research, Vol. 2, Issue 3
Structural Order Parameter in the Pyrochlore Superconductor Cd 2 Re 2 O 7
journal, July 2003
- A. Sergienko, Ivan; H. Curnoe, Stephanie
- Journal of the Physical Society of Japan, Vol. 72, Issue 7
Broken Symmetries
journal, August 1962
- Goldstone, Jeffrey; Salam, Abdus; Weinberg, Steven
- Physical Review, Vol. 127, Issue 3
Manifestation of structural Higgs and Goldstone modes in the hexagonal manganites
journal, July 2020
- Meier, Quintin N.; Stucky, Adrien; Teyssier, Jeremie
- Physical Review B, Vol. 102, Issue 1
Structural ordering and symmetry breaking in
journal, October 2002
- Castellan, J. P.; Gaulin, B. D.; van Duijn, J.
- Physical Review B, Vol. 66, Issue 13
Successive spatial symmetry breaking under high pressure in the spin-orbit-coupled metal
journal, January 2017
- Yamaura, Jun-ichi; Takeda, Keiki; Ikeda, Yoichi
- Physical Review B, Vol. 95, Issue 2
Magnetization and universal sub-critical behaviour in two-dimensional XY magnets
journal, January 1993
- Bramwell, S. T.; Holdsworth, P. C. W.
- Journal of Physics: Condensed Matter, Vol. 5, Issue 4
The pyrochlore family ? a potential panacea for the frustrated perovskite chemist
journal, January 2004
- Weller, Mark T.; Hughes, Robert W.; Rooke, Joanna
- Dalton Transactions, Issue 19
Spin-Peierls phases in pyrochlore antiferromagnets
journal, August 2002
- Tchernyshyov, Oleg; Moessner, R.; Sondhi, S. L.
- Physical Review B, Vol. 66, Issue 6
The Effects of Soft Modes on the Structure and Properties of Materials
journal, August 1976
- Fleury, P. A.
- Annual Review of Materials Science, Vol. 6, Issue 1
Machine learning for magnetic phase diagrams and inverse scattering problems
journal, November 2021
- Samarakoon, Anjana M.; Alan Tennant, D.
- Journal of Physics: Condensed Matter, Vol. 34, Issue 4
AXMAS Data
dataset, January 2021
- Osborn, Raymond; Rosenkranz, Stephan; Haley, Charlotte
- Materials Data Facility