Automatic Deep Sparse Multi-Trial Vector-based Differential Evolution clustering with manifold learning and incremental technique

• Published in: Image and vision computing Vol. 136; p. 104712
• Main Authors: Hadikhani, Parham, Lai, Daphne Teck Ching, Ong, Wee-Hong, Nadimi-Shahraki, Mohammad H.
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.08.2023
• Subjects: Auto-encoder; Deep clustering; Differential evolution; Dimension reduction; Evolutionary algorithm; Feature extraction; Image clustering; Unsupervised learning; Dimension reduction; Auto-encoder; Evolutionary algorithm; Deep clustering; Differential evolution; Feature extraction; Image clustering; Unsupervised learning
• DOI: 10.1016/j.imavis.2023.104712
• ISSN: 0262-8856

•A novel deep evolutionary clustering (ADSMTDE) to overcome clustering drawbacks.•Improving the auto-encoder by applying sparsity constraint and manifold learning.•To enhance clustering, evolutionary algorithm is adopted to optimize solutions.•Employing an incremental clustering technique to perform clustering dynamically.•ADSMTDE is competitive and superior to over the latest deep clustering methods. Most deep clustering methods despite utilizing complex networks to learn better from data, use a shallow clustering method. These methods have difficulty in finding good clusters due to the lack of ability to handle between local search and global search to prevent premature convergence. In other words, they do not consider different aspects of the search and it causes them to get stuck in the local optimum. In addition, the majority of existing deep clustering approaches perform clustering with the knowledge of the number of clusters, which is not practical in most real scenarios where such information is not available. To address these problems, this paper presents a novel automatic deep sparse clustering approach based on an evolutionary algorithm called Multi-Trial Vector-based Differential Evolution (MTDE). Sparse auto-encoder is first applied to extract embedded features. Manifold learning is then adopted to obtain representation and extract the spatial structure of features. Afterward, MTDE clustering is performed without prior information on the number of clusters to find the optimal clustering solution. The proposed approach was evaluated on various datasets, including images and time-series. The results demonstrate that the proposed method improved MTDE by 18.94% on average and compared to the most recent deep clustering algorithms, is consistently among the top three in the majority of datasets.