Learning lightweight tea detector with reconstructed feature and dual distillation

• Published in: Scientific reports Vol. 14; no. 1; pp. 23669 - 16
• Main Authors: Zheng, Zhe, Zuo, Guanpeng, Zhang, Wu, Zhang, Chenlu, Zhang, Jing, Rao, Yuan, Jiang, Zhaohui
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 10.10.2024; Nature Publishing Group; Nature Portfolio
• Subjects: 639/705/117; 639/705/794; Algorithms; Camellia sinensis; Computer applications; Deep Learning; Distillation; Distillation - methods; Feature distillation; Humanities and Social Sciences; Image Processing, Computer-Assisted - methods; Leaves; Model compression; Mountain regions; multidisciplinary; Natural environment; Neural networks; Neural Networks, Computer; Plant Leaves; Science; Science (multidisciplinary); Sensors; Students; Tea; Tea leaves detection; Feature distillation; Model compression; Tea leaves detection
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-024-73674-4

Currently, image recognition based on deep neural networks has become the mainstream direction of research; therefore, significant progress has been made in its application in the field of tea detection. Many deep models exhibit high recognition rates in tea leaves detection. However, deploying these models directly on tea-picking equipment in natural environments is impractical; the extremely high parameters and computational complexity of these models make it challenging to perform real-time tea leaves detection. Meanwhile, lightweight models struggle to achieve competitive detection accuracy; therefore, this paper addresses the issue of computational resource constraints in remote mountain areas and proposes Reconstructed Feature and Dual Distillation (RFDD) to enhance the detection capability of lightweight models for tea leaves. In our method, the Reconstructed Feature selectively masks the feature of the student model based on the spatial attention map of the teacher model; it utilizes a generation block to force the student model to generate the teacher’s full feature. The Dual Distillation comprises Decoupled Distillation and Global Distillation. Decoupled Distillation divides the reconstructed feature into foreground and background features based on the Ground-Truth. This compels the student model to allocate different attention to foreground and background, focusing on their critical pixels and channels. However, Decoupled Distillation leads to the loss of relation knowledge between foreground and background pixels. Therefore, we further perform Global Distillation to extract this lost knowledge. Since RFDD only requires loss calculation on feature map, it can be easily applied to various detectors. We conducted experiments on detectors with different frameworks, using a tea dataset collected at the Huangshan Houkui Tea Plantation. The experimental results indicate that, under the guidance of RFDD, the student detectors have achieved performance improvements to varying degrees. For instance, a one-stage detector like RetinaNet (ResNet-50) experienced a 3.14% increase in Average Precision (AP) after RFDD guidance. Similarly, a two-stage model like Faster RCNN (ResNet-50) obtained a 3.53% improvement in AP. This offers promising prospects for lightweight models to efficiently perform real-time tea leaves detection tasks.