On Clustering Histograms with k-Means by Using Mixed alpha-Divergences
Date
Authors
Nielsen, Frank
Nock, Richard
Amari, Shun-ichi
Journal Title
Journal ISSN
Volume Title
Publisher
Molecular Diversity Preservation International
Abstract
Clustering sets of histograms has become popular thanks to the success of the generic method of bag-of-X used in text categorization and in visual categorization applications. In this paper, we investigate the use of a parametric family of distortion measures, called the α-divergences, for clustering histograms. Since it usually makes sense to deal with symmetric divergences in information retrieval systems, we symmetrize the α-divergences using the concept of mixed divergences. First, we present a novel extension of k-means clustering to mixed divergences. Second, we extend the k-means++ seeding to mixed α-divergences and report a guaranteed probabilistic bound. Finally, we describe a soft clustering technique for mixed α-divergences.
Description
Keywords
Citation
Collections
Source
Entropy
Type
Book Title
Entity type
Access Statement
Open Access