Multitask Spectral Clustering by Exploring Intertask Correlation

• Published in: IEEE transactions on cybernetics Vol. 45; no. 5; pp. 1083 - 1094
• Main Authors: Yang, Yang, Ma, Zhigang, Yang, Yi, Nie, Feiping, Shen, Heng Tao
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.05.2015
• Subjects: Algorithm design and analysis; Clustering; Clustering algorithms; Coherence; Correlation; Educational institutions; Laplace equations; Linear programming; multitask; out-of-sample; Clustering; multitask; out-of-sample
• ISSN: 2168-2267; 2168-2275
• DOI: 10.1109/TCYB.2014.2344015

Clustering, as one of the most classical research problems in pattern recognition and data mining, has been widely explored and applied to various applications. Due to the rapid evolution of data on the Web, more emerging challenges have been posed on traditional clustering techniques: 1) correlations among related clustering tasks and/or within individual task are not well captured; 2) the problem of clustering out-of-sample data is seldom considered; and 3) the discriminative property of cluster label matrix is not well explored. In this paper, we propose a novel clustering model, namely multitask spectral clustering (MTSC), to cope with the above challenges. Specifically, two types of correlations are well considered: 1) intertask clustering correlation, which refers the relations among different clustering tasks and 2) intratask learning correlation, which enables the processes of learning cluster labels and learning mapping function to reinforce each other. We incorporate a novel l 2,p -norm regularizer to control the coherence of all the tasks based on an assumption that related tasks should share a common low-dimensional representation. Moreover, for each individual task, an explicit mapping function is simultaneously learnt for predicting cluster labels by mapping features to the cluster label matrix. Meanwhile, we show that the learning process can naturally incorporate discriminative information to further improve clustering performance. We explore and discuss the relationships between our proposed model and several representative clustering techniques, including spectral clustering, k -means and discriminative k -means. Extensive experiments on various real-world datasets illustrate the advantage of the proposed MTSC model compared to state-of-the-art clustering approaches.