Training Restricted Boltzmann Machines With a D-Wave Quantum Annealer
Restricted Boltzmann Machine (RBM) is an energy-based, undirected graphical model. It is commonly used for unsupervised and supervised machine learning. Typically, RBM is trained using contrastive divergence (CD). However, training with CD is slow and does not estimate the exact gradient of the log-likelihood cost function. In this work, the model expectation of gradient learning for RBM has been calculated using a quantum annealer (D-Wave 2000Q), where obtaining samples is faster than Markov chain Monte Carlo (MCMC) used in CD. Training and classification results of RBM trained using quantum annealing are compared with the CD-based method. The performance of the two approaches is compared with respect to the classification accuracies, image reconstruction, and log-likelihood results. The classification accuracy results indicate comparable performances of the two methods. Image reconstruction and log-likelihood results show improved performance of the CD-based method. It is shown that the samples obtained from quantum annealer can be used to train an RBM on a 64-bit “bars and stripes” dataset with classification performance similar to an RBM trained with CD. Though training based on CD showed improved learning performance, training using a quantum annealer could be useful as it eliminates computationally expensive MCMC steps of CD.
- Research Organization:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC), Basic Energy Sciences (BES)
- Grant/Contract Number:
- AC05-00OR22725; SC0019215; ERKCG12
- OSTI ID:
- 1804128
- Alternate ID(s):
- OSTI ID: 1807295
- Journal Information:
- Frontiers in Physics, Journal Name: Frontiers in Physics Vol. 9; ISSN 2296-424X
- Publisher:
- Frontiers Media SACopyright Statement
- Country of Publication:
- Switzerland
- Language:
- English
Similar Records
Restricted Boltzmann Machines for galaxy morphology classification with a quantum annealer
Adaptive hyperparameter updating for training restricted Boltzmann machines on quantum annealers