Community Channel-Net: Efficient channel-wise interactions via community graph topology

• Published in: Pattern recognition Vol. 141; p. 109536
• Main Authors: Feng, Fan, Liu, Qi, Peng, Zhanglin, Zhang, Ruimao, Chan, Rosa H.M.
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.09.2023
• Subjects: Complex Networks; Deep Neural Networks; Representation Learning; Complex Networks; Deep Neural Networks; Representation Learning
• ISSN: 0031-3203; 1873-5142
• DOI: 10.1016/j.patcog.2023.109536

•We unify the channel interaction methodologies through channel graph perspectives, which provide a general and flexible framework for interpreting, modeling, and designing channel interaction approaches in DNNs;•We identify the optimal interaction pattern for channel interaction, where the channel graphs are connected with community-structure topologies. The topology can effectively increase channel diversity and bring dynamic and sparse properties into the learning process. Based on this, a novel channel interaction method called CC-Net is proposed, learning the channel interdependence and keeping a high degree of channel diversity concurrently;•Experimental results indicate that our method outperforms other channel interaction methods in terms of the accuracy (i.e., classification error) and efficiency (i.e., model size and computational complexity). Highlights (for review) The layer-wise structure of deep neural networks (DNNs) isolates the channel interactions in the same layer, which significantly impedes the efficient learning of DNNs. Several existing methods enable channel-wise information exchange via learning channel interdependence in a heuristic and empirical manner. Nevertheless, only informative channels are emphasized while other channels are suppressed in these approaches. This results in a low channel diversity, which impeds the generalization of DNNs. Our work aims to learn channel-wise interdependence and keep the channel diversity concurrently via designing optimal channel interaction patterns. We model the channel interaction pattern from a graph perspective, where the interactions can be regarded as information exchange on the channel graph. Based on this framework, we propose the Community Channel-Net (CC-Net), using a community-based graph topology for channel interaction. Each community contains channels with semantic commonalities, and the inter-community connections are activated among critical channels. With this structured and dynamic topology, the channels from the same community can learn channel interdependence, and those critical channels from distinct communities can gain more diverse features. CC-Net outperforms baselines on image classification tasks over various backbones with fewer computational costs.