Generalized k-Labelsets Ensemble for Multi-Label and Cost-Sensitive Classification

• Published in: IEEE transactions on knowledge and data engineering Vol. 26; no. 7; pp. 1679 - 1691
• Main Authors: Lo, Hung-Yi, Lin, Shou-De, Wang, Hsin-Min
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.07.2014; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Classification; cost-sensitive learning; ensemble method; hypergraph; labelset; Laplace equations; Learning systems; Linear programming; multi-label classification; Optimization; Prediction algorithms; social tag; tag count; Tagging; Training; tag count; hypergraph; social tag; Multi-label classification; cost-sensitive learning; labelset; ensemble method
• ISSN: 1041-4347; 1558-2191
• DOI: 10.1109/TKDE.2013.112

Label powerset (LP) method is one category of multi-label learning algorithm. This paper presents a basis expansions model for multi-label classification, where a basis function is an LP classifier trained on a random k-labelset. The expansion coefficients are learned to minimize the global error between the prediction and the ground truth. We derive an analytic solution to learn the coefficients efficiently. We further extend this model to handle the cost-sensitive multi-label classification problem, and apply it in social tagging to handle the issue of the noisy training set by treating the tag counts as the misclassification costs. We have conducted experiments on several benchmark datasets and compared our method with other state-of-the-art multi-label learning methods. Experimental results on both multi-label classification and cost-sensitive social tagging demonstrate that our method has better performance than other methods.