Improving multi-scale detection layers in the deep learning network for wheat spike detection based on interpretive analysis

• Published in: Plant methods Vol. 19; no. 1; p. 46
• Main Authors: Yan, Jiawei, Zhao, Jianqing, Cai, Yucheng, Wang, Suwan, Qiu, Xiaolei, Yao, Xia, Tian, Yongchao, Zhu, Yan, Cao, Weixing, Zhang, Xiaohu
• Format: Journal Article
• Language: English
• Published: England BioMed Central Ltd 13.05.2023; BioMed Central; BMC
• Subjects: Algorithms; Analysis; Attention score; Climate change; Complexity; Crop yield; Crop yields; Datasets; Deep learning; Deep learning network; Feature extraction; Growth; Interpretive analysis; Machine learning; Mapping; Methodology; Methods; Neural networks; Wheat; Wheat spike detection; China; Interpretive analysis; Attention score; Wheat spike detection; Deep learning network
• ISSN: 1746-4811; 1746-4811
• DOI: 10.1186/s13007-023-01020-2

Detecting and counting wheat spikes is essential for predicting and measuring wheat yield. However, current wheat spike detection researches often directly apply the new network structure. There are few studies that can combine the prior knowledge of wheat spike size characteristics to design a suitable wheat spike detection model. It remains unclear whether the complex detection layers of the network play their intended role. This study proposes an interpretive analysis method for quantitatively evaluating the role of three-scale detection layers in a deep learning-based wheat spike detection model. The attention scores in each detection layer of the YOLOv5 network are calculated using the Gradient-weighted Class Activation Mapping (Grad-CAM) algorithm, which compares the prior labeled wheat spike bounding boxes with the attention areas of the network. By refining the multi-scale detection layers using the attention scores, a better wheat spike detection network is obtained. The experiments on the Global Wheat Head Detection (GWHD) dataset show that the large-scale detection layer performs poorly, while the medium-scale detection layer performs best among the three-scale detection layers. Consequently, the large-scale detection layer is removed, a micro-scale detection layer is added, and the feature extraction ability in the medium-scale detection layer is enhanced. The refined model increases the detection accuracy and reduces the network complexity by decreasing the network parameters. The proposed interpretive analysis method to evaluate the contribution of different detection layers in the wheat spike detection network and provide a correct network improvement scheme. The findings of this study will offer a useful reference for future applications of deep network refinement in this field.