Dynamic Salp swarm algorithm for feature selection

• Published in: Expert systems with applications Vol. 164; p. 113873
• Main Authors: Tubishat, Mohammad, Ja'afar, Salinah, Alswaitti, Mohammed, Mirjalili, Seyedali, Idris, Norisma, Ismail, Maizatul Akmar, Omar, Mardian Shah
• Format: Journal Article
• Language: English
• Published: New York Elsevier Ltd 01.02.2021; Elsevier BV
• Subjects: Accuracy; Datasets; Feature selection; Genetic algorithms; K-nearest neighbors algorithm; Local search algorithm (LSA); Optimization algorithms; Particle swarm optimization; Salp swarm algorithm; Search algorithms; Singer chaotic map; Statistical analysis; Salp swarm algorithm; Feature selection; Singer chaotic map; Local search algorithm (LSA)
• ISSN: 0957-4174; 1873-6793
• DOI: 10.1016/j.eswa.2020.113873

•A dynamic Salp swarm algorithm is proposed for feature selection.•The development of novel update equation to improve solutions diversity.•The development of new Local search algorithm to improve algorithm exploitation.•The algorithm was tested on 23 datasets and it is outperformed other algorithms. Recently, many optimization algorithms have been applied for Feature selection (FS) problems and show a clear outperformance in comparison with traditional FS methods. Therefore, this has motivated our study to apply the new Salp swarm algorithm (SSA) on the FS problem. However, SSA, like other optimizations algorithms, suffer from the problem of population diversity and fall into local optima. To solve these problems, this study presents an enhanced version of SSA which is known as the Dynamic Salp swarm algorithm (DSSA). Two main improvements were included in SSA to solve its problems. The first improvement includes the development of a new equation for salps’ position update. The use of this new equation is controlled by using Singer's chaotic map. The purpose of the first improvement is to enhance SSA solutions' diversity. The second improvement includes the development of a new local search algorithm (LSA) to improve SSA exploitation. The proposed DSSA was combined with the K-nearest neighbor (KNN) classifier in a wrapper mode. 20 benchmark datasets were selected from the UCI repository and 3 Hadith datasets to test and evaluate the effectiveness of the proposed DSSA algorithm. The DSSA results were compared with the original SSA and four well-known optimization algorithms including Particle Swarm Optimization (PSO), Genetic Algorithm (GA), Ant Lion Optimizer (ALO), and Grasshopper Optimization Algorithm (GOA). From the obtained results, DSSA outperformed the original SSA and the other well-known optimization algorithms over the 23 datasets in terms of classification accuracy, fitness function values, the number of selected features, and convergence speed. Also, DSSA accuracy results were compared with the most recent variants of the SSA algorithm. DSSA showed a significant improvement over the competing algorithms in statistical analysis. These results confirm the capability of the proposed DSSA to simultaneously improve the classification accuracy while selecting the minimal number of the most informative features.