Fixing convergence of Gaussian belief propagation
- Los Alamos National Laboratory
- IBM RESEARCH LAB
- HEBREW UNIV
Gaussian belief propagation (GaBP) is an iterative message-passing algorithm for inference in Gaussian graphical models. It is known that when GaBP converges it converges to the correct MAP estimate of the Gaussian random vector and simple sufficient conditions for its convergence have been established. In this paper we develop a double-loop algorithm for forcing convergence of GaBP. Our method computes the correct MAP estimate even in cases where standard GaBP would not have converged. We further extend this construction to compute least-squares solutions of over-constrained linear systems. We believe that our construction has numerous applications, since the GaBP algorithm is linked to solution of linear systems of equations, which is a fundamental problem in computer science and engineering. As a case study, we discuss the linear detection problem. We show that using our new construction, we are able to force convergence of Montanari's linear detection algorithm, in cases where it would originally fail. As a consequence, we are able to increase significantly the number of users that can transmit concurrently.
- Research Organization:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC52-06NA25396
- OSTI ID:
- 956533
- Report Number(s):
- LA-UR-09-00350; LA-UR-09-350; TRN: US201014%%1902
- Resource Relation:
- Conference: International Symposium on Information Theory 2009 ; June 28, 2009 ; Seol, Korea
- Country of Publication:
- United States
- Language:
- English
Similar Records
Physics-Informed CoKriging: A Gaussian-Process-Regression-Based Multifidelity Method for Data-Model Convergence
Detecting deviations from Gaussianity in high-redshift CMB lensing maps