An image rendering-based identification method for apples with different growth forms

• Published in: Computers and electronics in agriculture Vol. 211; p. 108040
• Main Authors: Lv, Jidong, Xu, Hao, Xu, Liming, Gu, Yuwan, Rong, Hailong, Zou, Ling
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.08.2023
• Subjects: Apples with different growth forms; Instance segmentation; Mask RCNN; PointRend; Instance segmentation; PointRend; Mask RCNN; Apples with different growth forms
• ISSN: 0168-1699; 1872-7107
• DOI: 10.1016/j.compag.2023.108040

•A method for apple growth morphology based on Mask RCNN + PointRend has been proposed.•SPPF structure, CA attention mechanism and PANet are introduced as improvements.•CWD algorithm is used for model distillation to improve the detection speed. Identifying apples with different growth forms is an urgent task to be solved by harvesting robots on the path to intelligence. A method based on Mask RCNN + PointRend was proposed for identifying apples with different growth forms in the orchard in the work. The SPPF structure and CA attention mechanism were introduced to the backbone network of the Mask RCNN + PointRend algorithm to improve network performance because of the complexity of the apple orchard. Meanwhile, a bottom-up pathway was introduced into the feature extraction network to enhance feature dissemination, reuse, and fitting. Finally, the number of model parameters was reduced to improve the detection speed, and the CWD algorithm was used for the knowledge distillation of the model. The improved algorithms were called Mask RCNN-Point and Mask RCNN-PointKD. The recognition accuracy of the two enhanced algorithms on the test set was 85.65 and 74.13%, respectively. Besides, average detection time per image was 93.67 and 62.1 ms, respectively. The work provides a reference for identifying apples with different growth forms.