DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Group-equivariant autoencoder for identifying spontaneously broken symmetries

Journal Article · · Physical Review. E

We introduce the group-equivariant autoencoder (GE autoencoder), a deep neural network (DNN) method that locates phase boundaries by determining which symmetries of the Hamiltonian have spontaneously broken at each temperature. We use group theory to deduce which symmetries of the system remain intact in all phases, and then use this information to constrain the parameters of the GE autoencoder such that the encoder learns an order parameter invariant to these “never-broken” symmetries. This procedure produces a dramatic reduction in the number of free parameters such that the GE-autoencoder size is independent of the system size. We include symmetry regularization terms in the loss function of the GE autoencoder so that the learned order parameter is also equivariant to the remaining symmetries of the system. By examining the group representation by which the learned order parameter transforms, we are then able to extract information about the associated spontaneous symmetry breaking. We test the GE autoencoder on the 2D classical ferromagnetic and antiferromagnetic Ising models, finding that the GE autoencoder (1) accurately determines which symmetries have spontaneously broken at each temperature; (2) estimates the critical temperature in the thermodynamic limit with greater accuracy, robustness, and time efficiency than a symmetry-agnostic baseline autoencoder; and (3) detects the presence of an external symmetry-breaking magnetic field with greater sensitivity than the baseline method. Lastly, we describe various key implementation details, including a quadratic-programming-based method for extracting the critical temperature estimate from trained autoencoders and calculations of the DNN initialization and learning rate settings required for fair model comparisons.

Research Organization:
Univ. of Tennessee, Knoxville, TN (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC), Basic Energy Sciences (BES)
Grant/Contract Number:
SC0022311; SC0018175
OSTI ID:
1972732
Alternate ID(s):
OSTI ID: 2339870
Journal Information:
Physical Review. E, Vol. 107, Issue 5; ISSN 2470-0045
Publisher:
American Physical Society (APS)Copyright Statement
Country of Publication:
United States
Language:
English

References (47)

Exact relations between droplets and thermal fluctuations in external field journal September 1989
Plasmons, Gauge Invariance, and Mass journal April 1963
Machine learning quantum phases of matter beyond the fermion sign problem journal August 2017
Accelerating lattice quantum Monte Carlo simulations using artificial neural networks: Application to the Holstein model journal July 2019
Unconventional superconductivity journal April 2017
The critical temperature of the 2D-Ising model through deep learning autoencoders journal December 2020
Quantum spin liquids: a review journal November 2016
Linking the pseudogap in the cuprates with local symmetry breaking: A commentary journal July 2019
Machine learning of explicit order parameters: From the Ising model to SU(2) lattice gauge theory journal November 2017
Quantum spin liquid states journal April 2017
Machine Learning Phases of Strongly Correlated Fermions journal August 2017
Acceleration of Liquid-Crystalline Phase Transition Simulations Using Selectively Scaled and Returned Molecular Dynamics journal June 2020
Quantum phase transitions via density-functional theory: Extension to the degenerate case journal October 2013
A review on computational modelling of phase-transition problems
  • Gomez, Hector; Bures, Miguel; Moure, Adrian
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 377, Issue 2143 https://doi.org/10.1098/rsta.2018.0203
journal March 2019
Linking entanglement and quantum phase transitions via density-functional theory journal November 2006
Discovering phase transitions with unsupervised learning journal November 2016
Super-resolving the Ising model with convolutional neural networks journal February 2019
Everything You Wanted to Know About Data Analysis and Fitting but Were Afraid to Ask book January 2015
Advances in Density-Functional Calculations for Materials Modeling journal July 2019
Monte Carlo Simulation in Statistical Physics journal January 1993
Reducing the Dimensionality of Data with Neural Networks journal July 2006
Molecular dynamics simulations of phase transitions in argon-filled single-walled carbon nanotube bundles under high pressure journal April 2009
Flow-based generative models for Markov chain Monte Carlo in lattice field theory journal August 2019
Stripe order in the underdoped region of the two-dimensional Hubbard model journal November 2017
Deep learning on the 2-dimensional Ising model to extract the crossover region with a variational autoencoder journal August 2020
Machine learning phases of matter journal February 2017
Self-learning Monte Carlo with deep neural networks journal May 2018
Hidden symmetry breaking and the Haldane phase inS=1 quantum spin chains journal July 1992
Self-learning Monte Carlo method journal January 2017
Colloquium : Theory of intertwined orders in high temperature superconductors journal May 2015
Unsupervised learning of phase transitions: From principal component analysis to variational autoencoders journal August 2017
Superconductivity in the doped Hubbard model and its interplay with next-nearest hopping t journal September 2019
Accurate critical pressures for structural phase transitions of group IV, III-V, and II-VI compounds from the SCAN density functional journal March 2018
Crystal Statistics. I. A Two-Dimensional Model with an Order-Disorder Transition journal February 1944
Metal-insulator transitions journal October 1998
From quantum matter to high-temperature superconductivity in copper oxides journal February 2015
Topological Orders in Rigid States journal February 1990
A perspective on machine learning and data science for strongly correlated electron problems journal October 2022
Unsupervised machine learning account of magnetic transitions in the Hubbard model journal January 2018
Symmetry-enforced self-learning Monte Carlo method applied to the Holstein model journal July 2018
A Density Functional Theory View of Quantum Phase Transitions journal January 2013
Text feature extraction based on deep learning: a review journal December 2017
Variational autoencoder analysis of Ising model statistical distributions and phase transitions journal March 2022
Self-learning Monte Carlo method with Behler-Parrinello neural networks journal March 2020
Continuum dynamics of the 1-D Heisenberg antiferromagnet: Identification with the O(3) nonlinear sigma model journal February 1983
The puzzle of high temperature superconductivity in layered iron pnictides and chalcogenides journal October 2010
Systematic Study of d -Wave Superconductivity in the 2D Repulsive Hubbard Model journal November 2005

Similar Records

Lorentz group equivariant autoencoders
Journal Article · 2023 · European Physical Journal. C, Particles and Fields (Online) · OSTI ID:1984537

Theory for Equivariant Quantum Neural Networks
Journal Article · 2024 · PRX Quantum · OSTI ID:2345955

Enhancing Lattice Kinetic Schemes for Fluid Dynamics with Lattice-Equivariant Neural Networks
Journal Article · 2024 · AIAA Journal · OSTI ID:2500873