Convergence Analysis of a New Self Organizing Map Based Optimization (SOMO) Algorithm

Khan, Atlas; Xue, Li Zheng; Wei, Wu; Qu, Yan Peng; Hussain, Amir; Vencio, Ricardo Z. N.

Abstract

The self-organizing map (SOM) approach has been used to perform cognitive and biologically inspired computing in a growing range of cross-disciplinary fields. Recently, the SOM based neural network framework was adapted to solve continuous derivative-free optimization problems through the development of a novel algorithm, termed SOM-based optimization (SOMO). However, formal convergence questions remained unanswered which we now aim to address in this paper. Specifically, convergence proofs are developed for the SOMO algorithm using a specific distance measure. Numerical simulation examples are provided using two benchmark test functions to support our theoretical findings, which illustrate that the distance between neurons decreases at each iteration and finally converges to zero. We also prove that the function value of the winner in the network decreases after each iteration. The convergence performance of SOMO has been benchmarked against the conventional particle swarm optimization algorithm, with preliminary results showing that SOMO can provide a more accurate solution for the case of large population sizes.

• Journal Article Type: Article
• Acceptance Date: Dec 26, 2014
• Online Publication Date: Jan 14, 2015
• Publication Date: 2015-08
• Deposit Date: Oct 10, 2019
• Journal: Cognitive Computation
• Print ISSN: 1866-9956
• Publisher: BMC
• Peer Reviewed: Peer Reviewed
• Volume: 7
• Issue: 4
• Pages: 477-486
• DOI: https://doi.org/10.1007/s12559-014-9315-7
• Keywords: SOMO; SOMO-based optimization algorithm; Particle swarm optimization; Extreme learning machine
• Public URL: http://researchrepository.napier.ac.uk/Output/1792881