Multimodal sparse support tensor machine for multiple classification learning

• Published in: International journal of machine learning and cybernetics Vol. 15; no. 4; pp. 1361 - 1373
• Main Authors: Wang, Shuangyue, Zhang, Xinrong, Luo, Ziyan, Wang, Yingnan
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.04.2024; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Classification; Complex Systems; Computational Intelligence; Constraints; Control; Engineering; Hyperplanes; Mechatronics; Newton methods; Operators (mathematics); Optimization; Original Article; Pattern Recognition; Robotics; Sparsity; Support vector machines; Systems Biology; Tensors; Multimodal data; Support tensor machine; Sparsity; Newton method; Multiple classification
• ISSN: 1868-8071; 1868-808X
• DOI: 10.1007/s13042-023-01972-w

This paper develops new multiple classification approaches in a direct manner for high-dimensional multimodal data. Firstly, we construct multiple hyperplanes via the tensor multimodal product and design a novel piecewise quadratic loss function ‘ ℓ cC ’ in the soft-margin scheme to propose the multimodal support tensor machine model (MSTM). Furthermore, to alleviate the overfitting phenomenon in small-size sampling instances, we construct a multimodal sparsity constrained support tensor machine model (MSSTM) by subtly imposing the sparsity constraint on the decision variables of the dual problem. In addition, the Newton method and subspace Newton method are employed to solve the MSTM and MSSTM models from the dual perspective, taking advantage of the differentiation properties of ‘ ℓ cC ’ and the hard-thresholding operator, respectively. Numerical experiments on four image datasets demonstrate the efficiency of the proposed methods in terms of classification accuracy and training time for multiple classification.