CE-FPN: enhancing channel information for object detection

• Published in: Multimedia tools and applications Vol. 81; no. 21; pp. 30685 - 30704
• Main Authors: Luo, Yihao, Cao, Xiang, Zhang, Juntao, Guo, Jingjuan, Shen, Haibo, Wang, Tianjiang, Feng, Qi
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.09.2022; Springer Nature B.V
• Subjects: Aliasing; Computer Communication Networks; Computer Science; Context; Convolution; Data Structures and Information Theory; Deep learning; Feature extraction; Feature maps; Flaw detection; Localization; Multimedia; Multimedia Information Systems; Object recognition; Performance evaluation; Pixels; Reduction; Sensors; Special Purpose and Application-Based Systems; Sub-pixel convolution; Feature pyramid network; Channel enhancement; Object detection
• DOI: 10.1007/s11042-022-11940-1
• ISSN: 1380-7501

Feature pyramid network (FPN) has been an efficient framework to extract multi-scale features in object detection. However, current FPN-based methods mostly suffer from the intrinsic flaw of channel reduction, which brings about the loss of semantical information. And the miscellaneous feature maps may cause serious aliasing effects. In this paper, we present a novel channel enhancement feature pyramid network (CE-FPN) to alleviate these problems. Specifically, inspired by sub-pixel convolution, we propose sub-pixel skip fusion (SSF) to perform both channel enhancement and upsampling. Instead of the original 1 × 1 convolution and linear upsampling, it mitigates the information loss due to channel reduction. Then we propose sub-pixel context enhancement (SCE) for extracting stronger feature representations, which is superior to other context methods due to the utilization of rich channel information by sub-pixel convolution. Furthermore, we introduce a channel attention guided module (CAG) to optimize the final integrated features on each level. It alleviates the aliasing effect only with a few computational burdens. We evaluate our approaches on Pascal VOC and MS COCO benchmark. Extensive experiments show that CE-FPN achieves competitive performance and is more lightweight compared to state-of-the-art FPN-based detectors.