Estimating the density of states of frustrated spin systems
Abstract
Abstract Estimating the density of states (DOS) of systems with rugged free energy landscapes is a notoriously difficult task of the utmost importance in many areas of physics ranging from spin glasses to biopolymers. DOS estimation has also recently become an indispensable tool for the benchmarking of quantum annealers when these function as samplers. Some of the standard approaches suffer from a spurious convergence of the estimates to metastable minima, and these cases are particularly hard to detect. Here, we introduce a sampling technique based on population annealing enhanced with a multi-histogram analysis and report on its performance for spin glasses. We demonstrate its ability to overcome the pitfalls of other entropic samplers, resulting in some cases in large scaling advantages that can lead to the uncovering of new physics. The new technique avoids some inherent difficulties in established approaches and can be applied to a wide range of systems without relevant tailoring requirements. Benchmarking of the studied techniques is facilitated by the introduction of several schemes that allow us to achieve exact counts of the degeneracies of the tested instances.
- Publication Date:
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1545896
- Resource Type:
- Published Article
- Journal Name:
- New Journal of Physics
- Additional Journal Information:
- Journal Name: New Journal of Physics Journal Volume: 21 Journal Issue: 7; Journal ID: ISSN 1367-2630
- Publisher:
- IOP Publishing
- Country of Publication:
- United Kingdom
- Language:
- English
Citation Formats
Barash, Lev, Marshall, Jeffrey, Weigel, Martin, and Hen, Itay. Estimating the density of states of frustrated spin systems. United Kingdom: N. p., 2019.
Web. doi:10.1088/1367-2630/ab2e39.
Barash, Lev, Marshall, Jeffrey, Weigel, Martin, & Hen, Itay. Estimating the density of states of frustrated spin systems. United Kingdom. https://doi.org/10.1088/1367-2630/ab2e39
Barash, Lev, Marshall, Jeffrey, Weigel, Martin, and Hen, Itay. Tue .
"Estimating the density of states of frustrated spin systems". United Kingdom. https://doi.org/10.1088/1367-2630/ab2e39.
@article{osti_1545896,
title = {Estimating the density of states of frustrated spin systems},
author = {Barash, Lev and Marshall, Jeffrey and Weigel, Martin and Hen, Itay},
abstractNote = {Abstract Estimating the density of states (DOS) of systems with rugged free energy landscapes is a notoriously difficult task of the utmost importance in many areas of physics ranging from spin glasses to biopolymers. DOS estimation has also recently become an indispensable tool for the benchmarking of quantum annealers when these function as samplers. Some of the standard approaches suffer from a spurious convergence of the estimates to metastable minima, and these cases are particularly hard to detect. Here, we introduce a sampling technique based on population annealing enhanced with a multi-histogram analysis and report on its performance for spin glasses. We demonstrate its ability to overcome the pitfalls of other entropic samplers, resulting in some cases in large scaling advantages that can lead to the uncovering of new physics. The new technique avoids some inherent difficulties in established approaches and can be applied to a wide range of systems without relevant tailoring requirements. Benchmarking of the studied techniques is facilitated by the introduction of several schemes that allow us to achieve exact counts of the degeneracies of the tested instances.},
doi = {10.1088/1367-2630/ab2e39},
journal = {New Journal of Physics},
number = 7,
volume = 21,
place = {United Kingdom},
year = {2019},
month = {7}
}
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1088/1367-2630/ab2e39
https://doi.org/10.1088/1367-2630/ab2e39
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 2 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Optimization of population annealing Monte Carlo for large-scale spin-glass simulations
journal, November 2018
- Barzegar, Amin; Pattison, Christopher; Wang, Wenlong
- Physical Review E, Vol. 98, Issue 5
Seeking Quantum Speedup Through Spin Glasses: The Good, the Bad, and the Ugly
journal, September 2015
- Katzgraber, Helmut G.; Hamze, Firas; Zhu, Zheng
- Physical Review X, Vol. 5, Issue 3
Exact integer algorithm for the two-dimensional ± J Ising spin glass
journal, November 1993
- Saul, Lawrence; Kardar, Mehran
- Physical Review E, Vol. 48, Issue 5
Probing for quantum speedup in spin-glass problems with planted solutions
journal, October 2015
- Hen, Itay; Job, Joshua; Albash, Tameem
- Physical Review A, Vol. 92, Issue 4
Thermalization, Freeze-out, and Noise: Deciphering Experimental Quantum Annealers
journal, December 2017
- Marshall, Jeffrey; Rieffel, Eleanor G.; Hen, Itay
- Physical Review Applied, Vol. 8, Issue 6
Random-cluster multihistogram sampling for the q -state Potts model
journal, February 2002
- Weigel, Martin; Janke, Wolfhard; Hu, Chin-Kun
- Physical Review E, Vol. 65, Issue 3
Architectural Considerations in the Design of a Superconducting Quantum Annealing Processor
journal, August 2014
- Bunyk, P. I.; Hoskinson, Emile M.; Johnson, Mark W.
- IEEE Transactions on Applied Superconductivity, Vol. 24, Issue 4
Histogram-free multicanonical Monte Carlo sampling to calculate the density of states
journal, February 2019
- Farris, Alfred C. K.; Li, Ying Wai; Eisenbach, Markus
- Computer Physics Communications, Vol. 235
Characterizing quantum supremacy in near-term devices
journal, April 2018
- Boixo, Sergio; Isakov, Sergei V.; Smelyanskiy, Vadim N.
- Nature Physics, Vol. 14, Issue 6
Exploration of NP-hard enumeration problems by simulated annealing — the spectrum values of permanents
journal, February 1999
- Nourani, Yaghout; Andresen, Bjarne
- Theoretical Computer Science, Vol. 215, Issue 1-2
Quantum annealing with manufactured spins
journal, May 2011
- Johnson, M. W.; Amin, M. H. S.; Gildert, S.
- Nature, Vol. 473, Issue 7346
Population annealing: Theory and application in spin glasses
journal, December 2015
- Wang, Wenlong; Machta, Jonathan; Katzgraber, Helmut G.
- Physical Review E, Vol. 92, Issue 6
Population Monte Carlo algorithms.
journal, January 2001
- Iba, Yukito
- Transactions of the Japanese Society for Artificial Intelligence, Vol. 16
Determining the density of states for classical statistical models: A random walk algorithm to produce a flat histogram
journal, October 2001
- Wang, Fugao; Landau, D. P.
- Physical Review E, Vol. 64, Issue 5
Morphology of ground states of two-dimensional frustration model
journal, February 1982
- Barahona, F.; Maynard, R.; Rammal, R.
- Journal of Physics A: Mathematical and General, Vol. 15, Issue 2
Stochastic Approximation in Monte Carlo Computation
journal, March 2007
- Liang, Faming; Liu, Chuanhai; Carroll, Raymond J.
- Journal of the American Statistical Association, Vol. 102, Issue 477
Minor-embedding in adiabatic quantum computation: II. Minor-universal graph design
journal, October 2010
- Choi, Vicky
- Quantum Information Processing, Vol. 10, Issue 3
New Algorithm for the Ising Problem: Partition Function for Finite Lattice Graphs
journal, June 2000
- Galluccio, Anna; Loebl, Martin; Vondrák, Jan
- Physical Review Letters, Vol. 84, Issue 26
GPU accelerated population annealing algorithm
journal, November 2017
- Barash, Lev Yu.; Weigel, Martin; Borovský, Michal
- Computer Physics Communications, Vol. 220
Multicanonical ensemble: A new approach to simulate first-order phase transitions
journal, January 1992
- Berg, Bernd A.; Neuhaus, Thomas
- Physical Review Letters, Vol. 68, Issue 1
Exchange Monte Carlo Method and Application to Spin Glass Simulations
journal, June 1996
- Hukushima, Koji; Nemoto, Koji
- Journal of the Physical Society of Japan, Vol. 65, Issue 6
Quantum annealing in the transverse Ising model
journal, November 1998
- Kadowaki, Tadashi; Nishimori, Hidetoshi
- Physical Review E, Vol. 58, Issue 5
Unraveling Quantum Annealers using Classical Hardness
journal, October 2015
- Martin-Mayor, Victor; Hen, Itay
- Scientific Reports, Vol. 5, Issue 1
Generic, Hierarchical Framework for Massively Parallel Wang-Landau Sampling
journal, May 2013
- Vogel, Thomas; Li, Ying Wai; Wüst, Thomas
- Physical Review Letters, Vol. 110, Issue 21
Efficient, Multiple-Range Random Walk Algorithm to Calculate the Density of States
journal, March 2001
- Wang, Fugao; Landau, D. P.
- Physical Review Letters, Vol. 86, Issue 10
Control of accuracy in the Wang-Landau algorithm
journal, October 2017
- Barash, L. Yu.; Fadeeva, M. A.; Shchur, L. N.
- Physical Review E, Vol. 96, Issue 4
On the computational complexity of Ising spin glass models
journal, October 1982
- Barahona, F.
- Journal of Physics A: Mathematical and General, Vol. 15, Issue 10
Janus: An FPGA-Based System for High-Performance Scientific Computing
journal, January 2009
- Belletti, Francesco; Cotallo, Maria; Cruz, A.
- Computing in Science & Engineering, Vol. 11, Issue 1
First order phase transitions in the canonical and the microcanonical ensemble
journal, September 1994
- H�ller, Alfred
- Zeitschrift f�r Physik B Condensed Matter, Vol. 93, Issue 3
Exploring first-order phase transitions with population annealing
journal, April 2017
- Barash, Lev Yu.; Weigel, Martin; Shchur, Lev N.
- The European Physical Journal Special Topics, Vol. 226, Issue 4
Convergence of Stochastic Approximation Monte Carlo and modified Wang–Landau algorithms: Tests for the Ising model
journal, July 2017
- Schneider, Simon; Mueller, Marco; Janke, Wolfhard
- Computer Physics Communications, Vol. 216
Exponentially Biased Ground-State Sampling of Quantum Annealing Machines with Transverse-Field Driving Hamiltonians
journal, February 2017
- Mandrà, Salvatore; Zhu, Zheng; Katzgraber, Helmut G.
- Physical Review Letters, Vol. 118, Issue 7
Estimation of effective temperatures in quantum annealers for sampling applications: A case study with possible applications in deep learning
journal, August 2016
- Benedetti, Marcello; Realpe-Gómez, John; Biswas, Rupak
- Physical Review A, Vol. 94, Issue 2
Massively parallel Wang–Landau sampling on multiple GPUs
journal, August 2012
- Yin, Junqi; Landau, D. P.
- Computer Physics Communications, Vol. 183, Issue 8
A Quantum Adiabatic Evolution Algorithm Applied to Random Instances of an NP-Complete Problem
journal, April 2001
- Farhi, E.; Goldstone, J.; Gutmann, S.
- Science, Vol. 292, Issue 5516
Population Annealing and Its Application to a Spin Glass
conference, January 2003
- Hukushima, K.
- THE MONTE CARLO METHOD IN THE PHYSICAL SCIENCES: Celebrating the 50th Anniversary of the Metropolis Algorithm, AIP Conference Proceedings
Advantages of Unfair Quantum Ground-State Sampling
journal, April 2017
- Zhang, Brian Hu; Wagenbreth, Gene; Martin-Mayor, Victor
- Scientific Reports, Vol. 7, Issue 1
Patch-planting spin-glass solution for benchmarking
journal, August 2017
- Wang, Wenlong; Mandrà, Salvatore; Katzgraber, Helmut G.
- Physical Review E, Vol. 96, Issue 2
Gauge-invariant method for the ± J spin-glass model
journal, September 1991
- Blackman, J. A.; Poulter, J.
- Physical Review B, Vol. 44, Issue 9
Exact Distribution of Energies in the Two-Dimensional Ising Model
journal, January 1996
- Beale, Paul D.
- Physical Review Letters, Vol. 76, Issue 1
Hiding Solutions in Random Satisfiability Problems: A Statistical Mechanics Approach
journal, April 2002
- Barthel, W.; Hartmann, A. K.; Leone, M.
- Physical Review Letters, Vol. 88, Issue 18
Optimized Monte Carlo data analysis
journal, September 1989
- Ferrenberg, Alan M.; Swendsen, Robert H.
- Physical Review Letters, Vol. 63, Issue 12
Tunneling spectroscopy using a probe qubit
journal, January 2013
- Berkley, A. J.; Przybysz, A. J.; Lanting, T.
- Physical Review B, Vol. 87, Issue 2
Fast algorithm to calculate density of states
journal, April 2007
- Belardinelli, R. E.; Pereyra, V. D.
- Physical Review E, Vol. 75, Issue 4
Massively parallel multicanonical simulations
journal, March 2018
- Gross, Jonathan; Zierenberg, Johannes; Weigel, Martin
- Computer Physics Communications, Vol. 224
Hiding Quiet Solutions in Random Constraint Satisfaction Problems
journal, June 2009
- Krzakala, Florent; Zdeborová, Lenka
- Physical Review Letters, Vol. 102, Issue 23
Cross Correlations in Scaling Analyses of Phase Transitions
journal, March 2009
- Weigel, Martin; Janke, Wolfhard
- Physical Review Letters, Vol. 102, Issue 10
Fast Calculation of the Density of States of a Fluid by Monte Carlo Simulations
journal, January 2003
- Yan, Qiliang; de Pablo, Juan J.
- Physical Review Letters, Vol. 90, Issue 3
Error estimation and reduction with cross correlations
journal, June 2010
- Weigel, Martin; Janke, Wolfhard
- Physical Review E, Vol. 81, Issue 6
Computational Difficulty of Computing the Density of States
journal, July 2011
- Brown, Brielin; Flammia, Steven T.; Schuch, Norbert
- Physical Review Letters, Vol. 107, Issue 4
Exact ground states of large two-dimensional planar Ising spin glasses
journal, November 2008
- Pardella, G.; Liers, F.
- Physical Review E, Vol. 78, Issue 5
Domain-wall excitations in the two-dimensional Ising spin glass
journal, February 2018
- Khoshbakht, Hamid; Weigel, Martin
- Physical Review B, Vol. 97, Issue 6
Spin glasses: Experimental facts, theoretical concepts, and open questions
journal, October 1986
- Binder, K.; Young, A. P.
- Reviews of Modern Physics, Vol. 58, Issue 4
Population annealing with weighted averages: A Monte Carlo method for rough free-energy landscapes
journal, August 2010
- Machta, J.
- Physical Review E, Vol. 82, Issue 2
Funnels, pathways, and the energy landscape of protein folding: A synthesis
journal, March 1995
- Bryngelson, Joseph D.; Onuchic, José Nelson; Socci, Nicholas D.
- Proteins: Structure, Function, and Genetics, Vol. 21, Issue 3
On the ground states of the frustration model of a spin glass by a matching method of graph theory
journal, August 1980
- Bieche, L.; Uhry, J. P.; Maynard, R.
- Journal of Physics A: Mathematical and General, Vol. 13, Issue 8
Make Life Simple: Unleash the Full Power of the Parallel Tempering Algorithm
journal, September 2008
- Bittner, Elmar; Nußbaumer, Andreas; Janke, Wolfhard
- Physical Review Letters, Vol. 101, Issue 13
GPU-Accelerated Population Annealing Algorithm: Frustrated Ising Antiferromagnet on the Stacked Triangular Lattice
journal, January 2016
- Borovský, Michal; Weigel, Martin; Barash, Lev Yu.
- EPJ Web of Conferences, Vol. 108
Analysis and optimization of population annealing
journal, March 2018
- Amey, Christopher; Machta, Jonathan
- Physical Review E, Vol. 97, Issue 3
Quantum Boltzmann Machine
journal, May 2018
- Amin, Mohammad H.; Andriyash, Evgeny; Rolfe, Jason
- Physical Review X, Vol. 8, Issue 2
Feedback-optimized parallel tempering Monte Carlo
journal, March 2006
- Katzgraber, Helmut G.; Trebst, Simon; Huse, David A.
- Journal of Statistical Mechanics: Theory and Experiment, Vol. 2006, Issue 03
Minor-embedding in adiabatic quantum computation: I. The parameter setting problem
journal, September 2008
- Choi, Vicky
- Quantum Information Processing, Vol. 7, Issue 5