Convergence Analysis of a New Self Organizing Map Based Optimization (SOMO) Algorithm

• Published in: Cognitive computation Vol. 7; no. 4; pp. 477 - 486
• Main Authors: Khan, Atlas, Xue, Li Zheng, Wei, Wu, Qu, YanPeng, Hussain, Amir, Vencio, Ricardo Z. N.
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.08.2015; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Biomedical and Life Sciences; Biomedicine; Computation by Abstract Devices; Computational Biology/Bioinformatics; Convergence; Iterative methods; Neural networks; Neurons; Neurosciences; Optimization algorithms; Particle swarm optimization; Self organizing maps; SOM; SOMO-based optmiztion algorithm; Extreme learning machine; Particle swarm optimization
• ISSN: 1866-9956; 1866-9964
• DOI: 10.1007/s12559-014-9315-7

The self-organizing map (SOM) approach has been used to perform cognitive and biologically inspired computing in a growing range of cross-disciplinary fields. Recently, the SOM based neural network framework was adapted to solve continuous derivative-free optimization problems through the development of a novel algorithm, termed SOM-based optimization (SOMO). However, formal convergence questions remained unanswered which we now aim to address in this paper. Specifically, convergence proofs are developed for the SOMO algorithm using a specific distance measure. Numerical simulation examples are provided using two benchmark test functions to support our theoretical findings, which illustrate that the distance between neurons decreases at each iteration and finally converges to zero. We also prove that the function value of the winner in the network decreases after each iteration. The convergence performance of SOMO has been benchmarked against the conventional particle swarm optimization algorithm, with preliminary results showing that SOMO can provide a more accurate solution for the case of large population sizes.