Penalized partial least square discriminant analysis with for multi-label data

• Published in: Pattern recognition Vol. 48; no. 5; pp. 1724 - 1733
• Main Authors: Liu, Huawen, Ma, Zongjie, Zhang, Shichao, Wu, Xindong
• Format: Journal Article
• Language: English
• Published: 01.05.2015
• Subjects: Correlation; Discriminant analysis; Labels; Learning; Least squares method; Optimization; Pattern recognition; Receiving
• ISSN: 0031-3203
• DOI: 10.1016/j.patcog.2014.11.007

Multi-label data are prevalent in real world. Due to its great potential applications, multi-label learning has now been receiving more and more attention from many fields. However, how to effectively exploit the correlations of variables and labels, and tackle the high-dimensional problems of data are two major challenging issues for multi-label learning. In this paper we make an attempt to cope with these two problems by proposing an effective multi-label learning algorithm. Specifically, we make use of the technique of partial least square discriminant analysis to identify a common latent space between the variable space and the label space of multi-label data. Moreover, considering the label space of the multi-label data is sparse, a l sub(1)-norm penalty is further performed to constrain the Y-loadings of the optimization problem of partial least squares, making them sparse. The merit of our method is that it can capture the correlations and perform dimension reduction at the same time. The experimental results conducted on eleven public data sets show that our method is promising and superior to the state-of-the-art multi-label classifiers in most cases.