Clustering High Dimensional data using hubness phenomenon

High-dimensional data arise naturally in many domains, and have regularly presented a great challenge for traditional data-mining techniques, both in terms of effectiveness and efficiency. Clustering becomes difficult due to the increasing sparsity of such data, as well as the increasing difficulty in distinguishing distances between data points. In this paper we take a novel perspective on the problem of clustering high-dimensional data.

Instead of attempting to avoid the curse of dimensionality by observing a lower-dimensional feature subspace, we embrace dimensionality by taking advantage of inherently high-dimensional phenomena. More specifically, we show that hubness, i.e., the tendency of high-dimensional data to contain points (hubs) that frequently occur in k-nearest neighbor lists of other points, can be successfully exploited in clustering. We validate our ypothesis by demonstrating that hubness is a good measure of point centrality within a high-dimensional data cluster, and by roposing several hubness-based clustering algorithms, showing that major hubs can be used effectively as cluster prototypes or as guides during the search for centroid-based cluster configurations. Experimental results demonstrate good performance of our algorithms in multiple settings, particularly in the presence of large quantities of noise. The proposed methods are tailored mostly for detecting approximately hyperspherical clusters and need to be extended in order to properly handle clusters of arbitrary shapes.
www.fu-vision .com
www.fu- craft.com
www.fu-vision animedia.com
contact for more information: 9003206648
Coimbatore Address:
No: 96,Hope College bus stop,
Opp Krishna sweets, Peelamedu,
Avinashi road, Coimbatore.

Madurai Address:
near BELL Hotel,
Rajan Complex – 3rd floor
Tamil Sangam Road,