Multi-label feature selection via manifold regularization and dependence maximization

• Published in: Pattern recognition Vol. 120; p. 108149
• Main Authors: Huang, Rui, Wu, Zhejun
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.12.2021
• Subjects: Dependence maximization; Feature selection; Manifold regularization; Multi-label learning; Sparse regression; Multi-label learning; Feature selection; Sparse regression; Manifold regularization; Dependence maximization
• ISSN: 0031-3203; 1873-5142
• DOI: 10.1016/j.patcog.2021.108149

•Presenting a new multi-label feature selection method that efficiently combines manifold regularization and dependence maximization.•Introducing a HSIC-based measurement to evaluate the dependence between the manifold space and label space.•Developing an iterative optimization method to solve the objective function of our method MRDM with good convergence.•Conducting extensive experiments on various multi-label data sets to demonstrate the superiority of the proposed method. Feature selection is able to select more discriminative features for classification and plays an important role in multi-label learning to alleviate the effect of the curse of dimensionality. Recently, the multi-label feature selection methods based on the sparse regression model have received increasing attentions. However, most of these methods directly project original data space to label space in the regression model, which is inappropriate because the linear assumption between data space and label space doesn't hold in most cases. In the paper, we propose a feature selection method named multi-label feature selection via manifold regularization and dependence maximization (MRDM). In the regression model of MRDM, the original data space is projected to a low-dimensional manifold space, which not only has the same topological structure with the original data, but also has a strong dependence with the class labels. Then, an objective function involving l2,1-norm regularization is formulated, and an alternating optimization-based iterative algorithm is designed to obtain the sparse coefficients for multi-label feature selection. Extensive experiments on various multi-label data sets demonstrate the superiority of the proposed method compared with some state-of-the-art multi-label feature selection methods.