Fast Detection of Tomato Sucker Using Semantic Segmentation Neural Networks Based on RGB-D Images

• Published in: Sensors (Basel, Switzerland) Vol. 22; no. 14; p. 5140
• Main Authors: Giang, Truong Thi Huong, Khai, Tran Quoc, Im, Dae-Young, Ryoo, Young-Jae
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.07.2022; MDPI
• Subjects: Accuracy; Cameras; Datasets; Farms; Frames per second; Fruits; Image classification; Internet of Things; Literature reviews; Neural networks; Real time; RGB-D; Semantic segmentation; semantic segmentation neural network; Semantics; tomato pruning; tomato sucker detection; Tomatoes
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s22145140

Tomato sucker or axillary shoots should be removed to increase the yield and reduce the disease on tomato plants. It is an essential step in the tomato plant care process. It is usually performed manually by farmers. An automated approach can save a lot of time and labor. In the literature review, we see that semantic segmentation is a process of recognizing or classifying each pixel in an image, and it can help machines recognize and localize tomato suckers. This paper proposes a semantic segmentation neural network that can detect tomato suckers quickly by the tomato plant images. We choose RGB-D images which capture not only the visual of objects but also the distance information from objects to the camera. We make a tomato RGB-D image dataset for training and evaluating the proposed neural network. The proposed semantic segmentation neural network can run in real-time at 138.2 frames per second. Its number of parameters is 680, 760, much smaller than other semantic segmentation neural networks. It can correctly detect suckers at 80.2%. It requires low system resources and is suitable for the tomato dataset. We compare it to other popular non-real-time and real-time networks on the accuracy, time of execution, and sucker detection to prove its better performance.