A Hybrid Particle Swarm Optimization Algorithm with Dynamic Adjustment of Inertia Weight Based on a New Feature Selection Method to Optimize SVM Parameters

• Published in: Entropy (Basel, Switzerland) Vol. 25; no. 3; p. 531
• Main Authors: Wang, Jing, Wang, Xingyi, Li, Xiongfei, Yi, Jiacong
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 19.03.2023; MDPI
• Subjects: Accuracy; Algorithms; Analysis; Classification; Datasets; Efficiency; Feature selection; FS-score; Genetic algorithms; Heuristic; Inertia; Mathematical optimization; Methods; Optimization; Optimization models; Parameters; Particle swarm optimization; Support vector machines; SVM; Swarm intelligence; Vector analysis; Weighting (Statistics); China; SVM; particle swarm optimization; optimization; FS-score; feature selection
• ISSN: 1099-4300; 1099-4300
• DOI: 10.3390/e25030531

Support vector machine (SVM) is a widely used and effective classifier. Its efficiency and accuracy mainly depend on the exceptional feature subset and optimal parameters. In this paper, a new feature selection method and an improved particle swarm optimization algorithm are proposed to improve the efficiency and the classification accuracy of the SVM. The new feature selection method, named Feature Selection-score (FS-score), performs well on data sets. If a feature makes the class external sparse and the class internal compact, its FS-score value will be larger and the probability of being selected will be greater. An improved particle swarm optimization model with dynamic adjustment of inertia weight (DWPSO-SVM) is also proposed to optimize the parameters of the SVM. By improving the calculation method of the inertia weight of the particle swarm optimization (PSO), inertia weight can decrease nonlinearly with the number of iterations increasing. In particular, the introduction of random function brings the inertia weight diversity in the later stage of the algorithm and the global searching ability of the algorithm to avoid falling into local extremum. The experiment is performed on the standard UCI data sets whose features are selected by the FS-score method. Experiments demonstrate that our algorithm achieves better classification performance compared with other state-of-the-art algorithms.