Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network

  Advanced Search  

Kernelized Infomax Clustering Felix V. Agakov

Summary: Kernelized Infomax Clustering
Felix V. Agakov
Edinburgh University
Edinburgh EH1 2QL, U.K.
David Barber
IDIAP Research Institute
CH-1920 Martigny Switzerland
We propose a simple information-theoretic approach to soft clus-
tering based on maximizing the mutual information I(x, y) between
the unknown cluster labels y and the training patterns x with re-
spect to parameters of specifically constrained encoding distribu-
tions. The constraints are chosen such that patterns are likely to
be clustered similarly if they lie close to specific unknown vectors
in the feature space. The method may be conveniently applied to
learning the optimal affinity matrix, which corresponds to learn-
ing parameters of the kernelized encoder. The procedure does not
require computations of eigenvalues of the Gram matrices, which


Source: Agakov, Felix - Institute for Adaptive and Neural Computation, School of Informatics, University of Edinburgh


Collections: Computer Technologies and Information Sciences