A Particle Swarm Optimization-Based Flexible Convolutional Autoencoder for Image Classification

• Published in: IEEE transaction on neural networks and learning systems Vol. 30; no. 8; pp. 2295 - 2309
• Main Authors: Sun, Yanan, Xue, Bing, Zhang, Mengjie, Yen, Gary G.
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.08.2019; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Artificial neural networks; Classification; Computer applications; Computer architecture; Convolution; Convolutional autoencoder (CAE); Convolutional codes; deep learning; Image classification; Neural networks; Optimization; Particle swarm optimization; particle swarm optimization (PSO); Stacking
• ISSN: 2162-237X; 2162-2388; 2162-2388
• DOI: 10.1109/TNNLS.2018.2881143

Convolutional autoencoders (CAEs) have shown their remarkable performance in stacking to deep convolutional neural networks (CNNs) for classifying image data during the past several years. However, they are unable to construct the state-of-the-art CNNs due to their intrinsic architectures. In this regard, we propose a flexible CAE (FCAE) by eliminating the constraints on the numbers of convolutional layers and pooling layers from the traditional CAE. We also design an architecture discovery method by exploiting particle swarm optimization, which is capable of automatically searching for the optimal architectures of the proposed FCAE with much less computational resource and without any manual intervention. We test the proposed approach on four extensively used image classification data sets. Experimental results show that our proposed approach in this paper significantly outperforms the peer competitors including the state-of-the-art algorithms.