Influence of initialization on the performance of metaheuristic optimizers

• Published in: Applied soft computing Vol. 91; p. 106193
• Main Authors: Li, Qian, Liu, San-Yang, Yang, Xin-She
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.06.2020
• Subjects: Cuckoo search; Differential evolution; Initialization; Particle swarm optimization; Probability distribution; Initialization; Differential evolution; Cuckoo search; Probability distribution; Particle swarm optimization
• DOI: 10.1016/j.asoc.2020.106193
• ISSN: 1568-4946

All metaheuristic optimization algorithms require some initialization, and the initialization for such optimizers is usually carried out randomly. However, initialization can have some significant influence on the performance of such algorithms. This paper presents a systematic comparison of 22 different initialization methods on the convergence and accuracy of five optimizers: differential evolution (DE), particle swarm optimization (PSO), cuckoo search (CS), artificial bee colony (ABC) and genetic algorithm (GA). We have used 19 different test functions with different properties and modalities to compare the possible effects of initialization, population sizes and the numbers of iterations. Rigorous statistical ranking tests indicate that 43.37% of the functions using the DE algorithm show significant differences for different initialization methods, while 73.68% of the functions using both PSO and CS algorithms are significantly affected by different initialization methods. The simulations show that DE is less sensitive to initialization, while both PSO and CS are more sensitive to initialization. In addition, under the condition of the same maximum number of fitness evaluations (FEs), the population size can also have a strong effect. Particle swarm optimization usually requires a larger population, while the cuckoo search needs only a small population size. Differential evolution depends more heavily on the number of iterations, a relatively small population with more iterations can lead to better results. Furthermore, ABC is more sensitive to initialization, while such initialization has little effect on GA. Some probability distributions such as the beta distribution, exponential distribution and Rayleigh distribution can usually lead to better performance. The implications of this study and further research topics are also discussed in detail. •A systematical comparison of 22 different initialization methods for 5 algorithms.•A parametric study of the effects of the population size and number of iterations.•A detailed analysis of experimental results using statistical ranking techniques.