Ultra Fast Classification and Regression of High-Dimensional Problems Projected on 2D

• Published in: Neural processing letters Vol. 55; no. 5; pp. 5377 - 5400
• Main Authors: Alateyat, Heba, Fernández-Delgado, Manuel, Cernadas, Eva, Barro, Senén
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.10.2023; Springer Nature B.V
• Subjects: Artificial Intelligence; Classification; Complex Systems; Computational Intelligence; Computer Science; Datasets; Design; Discriminant analysis; Eigenvectors; Machine learning; Methods; Neural networks; Regression; Visualization; Dimensionality reduction; Regression; Mapping; Linear discriminant analysis; Data visualization; Classification
• ISSN: 1370-4621; 1573-773X
• DOI: 10.1007/s11063-022-11090-3

We propose the two-dimensional visual map classifier and regressor, which project the high-dimensional patterns on a 2D map, for human visualization and understanding of the data, and afterwards define a classification or regression map that predicts, for each 2D pattern, the class label (in classification) or the output value (in regression). The 2D projection is performed using the linear discriminant analysis, due to its high performance, speed and ability to project unseen (out-of-sample) patterns. The map is defined in an efficient way by assigning the proper output value to each square (or pixel) in the 2D map. The experiments show that the maps defined by both methods: (1) allow to understand visually the data distribution of a classification or regression problem; (2) their performances are very near to the state-of-the-art support vector classification and regression, including wrappers; and (3) they are very fast, between 1 and 5 orders of magnitude faster than the other approaches, spending less than 1 min to classify datasets with 5 million patterns. Matlab code is available.